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[fl*3l] lifffttSoipyhgi'PfeoT, 

^■Wtmx feet k f 5 p # -y h =&Bo 
[lt*32] ±EHHB»IWfil^, tS®kLTBl§S: 

[» *3 3 ] '>£ < k & rtSEK«{clS"tJv>T S Wt» 
fcLTfctK 

±Eff»«iJ»^att^ rtgP^Sg<0HS1StS^^T> ± 10 
Etit?KI#fff)£S-a:3c fcftWttfcT*!!** l Eft 

[11*3 4 ] lErtSWaftDgftB^fc UTOflHBS 

±BfT»«n^«tt, ±ihiwrwww>><5 * - **<m 

[«t*3 5 ] ±EJjaMHH»«©/< 5 tffiR 

SBo 20 
[Wis 6] ±E«*WW*©/*5*-*<* ^B'N 

©»iia»*jjvf fcoT&sckfcwak-rs nt*3 4 e 

tt©a#*y MtBo 

[1**37] ±Ei**af#sw)><5*-*ff, am 

Bo 

[11*38] ±E«fB«*#&©^7*-*tf, Srffilft 
m<D¥WMV&% c £*¥f®£? 5W*34E«©p# 
■y HSBo 

[ii*39] ±e^s**^ igi^wfiiw^-rs^ga 30 

T&0, 

1 t , ±e* mttmm zitzctzfflktt 

[Ii!*3 10] a # <y h SB© &nffim<D-fm £ 

imxm 1 1 ] nmnvwmmmzmm®^®. 

*mfL tc CtZm&t? 5 P#-y h^Bo 
[11*312] W^Kfi8fC»^>TtT®)*LT*50, 40 
±EK"ft»1i*®tt, ±EJ**1»fc:*tr 3fr»* t k 

Bo 

c»*« 1 3 ] ±Ertsu«iB*«ai"r s 
«k-rsai#jgi 2E«©a#v h^Bo so 



2002-219677 

2 

[fl!*3 l 4 ] ±E»» 

HBfcna^ttTa«E* lt* < »seis^8*«*.t 

[»*3l5] rt»KI8K*^^TfT»*LTV^* 
p*<y h*H*^*WfcJ*"rsff»*Lfei:fr<D, ±E 

i6] ^PKfi^mt, 

^LfcBO*B«5iJ©WWifc:»"^>TK»»t«nfc 

±E^A^¥ISt^^n/c^iSA7^%, ±HB*»«5»J 
«F«€-r^{cS-3v^Tff«-rs«SSA*IMlS?®i:» 
±ESgiSArti¥fiB#a©f¥«»fc:g^T, ±EJ8BA 
7^ ©mfg^J^f^T S JWSS»"Jft^® k $tl A It £ 

[11*31 7] ±K8KA*fWatt, ±E^A 

«nitiwiiiiii»i:, ±Kmtmiktowmmi>it 
m?z>mmt&t*ffiz.rc£t*mi£-tzm&mi 6E 

«<DP#-y h^Bo 

[»*3 1 8 ] ±BttMft tuawtttij L' rc^mxt} 
s»-r s * r ;pas¥a*fli a * c k k f a»# 

31 7EiOa#7 h^Bo 
C1*S19] ±E#W*MW«*7*/Ptt, 
fc«t 0^c*ffl»5iJO«fl«%WUTi/^c k%«f«k 
•TSM*3 1 6£tOniK7 bSBo 

©JWfil^JOl#»*k:S^^TK»*t*nfc«»0#Ji 

iS^^T'yl/tcS^^Tffffit-^fglSA^ffffiXg 

k, 

XEfSfSA^ffFffliXg^Ttf/cffFfflSffltca^^T, ±E 

[11*32 1 ] l*Ri%t5D#y h^BtCfe^ 
T, 

filA/cC k^^kf 5 P^-y hgBo 

[W*32 2] n»W»tcil^V^T«r3£«nfc1*«:« 
$tLT¥gW^tlk UTff»*S-B-S*iJ»¥a*fllA7fc 
£k£#®kf 311*32 lEtt<DP#-y h^Bo 

[|»*3 2 3 ] #«f£*jSf!T»k LT i 3©^S« 
ma^Lirstc k^^k-r§IS*32 l E«onjt? 
>y h^Bo 

[»*32 4] ktPa5%H^.fc®i»c^L/'c 

w«^ttfc®<a?nTfe»), 



3 

n&GU*m*tzz t*ft@it ? zmim 2 1 safe© 

p#<y HI, 

^tnma^m uwi^n # <y h ««©fT»**i»"r 

* c i: *«W i: -T * o si? *y h S«©fT»*J»Sffio 

±ae-b v 6 (DXiim^mmt & *mnmm mu t , 

i^JIfflff^OBWeatfArtStU ±£ffB&$ 

mftfflvmvmt t ±s&m<to t zmmz &t±ksbm 
±Mmmt-imttmiiz.w i ~3< mmmmm®tt±mm 

rat#« 3 o ] ±u\H^mmmmt, mmmmmx 
nm^mcm 2 mmtmm u 
*f»*±j«-f s c t t?z m$.m 2 8 nmo a # 

>y h^Bo 

cw*a 31] g W5»f 5 p 4? >y h mmoxmu® 
mmxmt, 

oBWRifeffiis^SteEit-r s gams t * w L , 
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[000 1] 

©J^&P^y h&BOffl&fiiflSJWffifiira-f So 
[000 2] 

issnfcptfy hStBtflittSft-cvs. :oni7 h 

10 ©tr**"*" SfcOtffcSo $6{c, C0<fc$*ps|?'y b 
[0 0 0 3] 

p#-y hSBfcfcttS 1 oo^SOBWi^-r?^* 
(Life-like) fcP#>y KftBSKIiStSC » 

cmm^tftlf. t-^xyf-fyh (OPEN-ENDE 

D) !&'>X-ri*%#IIB-r*c4:4:^5o 
[0 0 0 4] ftjfeti, ^fc«»Sfc«LTia-&3ft\ 
20 ^V^vCtt'^?^^ (life-like) fcnstf-y hSt 

[0 0 0 5] LfrU ^COUgJiftlft^fiScCDfcfetcS^ 

[0 0 0 6] ff»04ia«R J if» J E-0^i'->tta.— tf- 
B*t.^«8lfi*»LT«»r^t.OO, (^P^* 
ft^. IW)i:<, n#7 M6BtJ:0B»nI^fc«n5W 

[0 0 0 7] ^tt#c0^5:Mx.?>^-r>'xy : rV <y 
b (OPEN-ENDED) ft^Xx^fcttSfcfcfc&EftC 

(1) *mmztm?2zmji 
40 (2) mcrsimzmzitzmt) 

(3) *to»j»fcwaawfcfT»*B«-r«fca 

5 etc, ^<y h®OP#y hSBT»*Cfc%%§IUfe 

^ 5 ^ a >*m cr^s-r 5 c t m^<D t «*T-fe 

[0 0 0 8] ARa^O-T-y^^ayKfc^TftkK 

±5licr) (1) ©*»*J»&B»"rSte*JfcB8LTtt, jg 
50 ^J^Axrf^-rX^^iO^yjp;!/ (Symbol) i: LT<D^ 



(4) 

5 

lt®mmzmmttVmWi1&t& (Ground) LX^ZCt 

[0 0 0 9] cnm 0IRtf, KaplanlC^^ 
(Kaplan, F. Talking AIBO: Firstexperimentation of 
verbal interactions with an autonomous four-legge 
d robot. In proceedings of the CELE-Twente worksho 
p on interacting agents, October, 2000, UTF, %M 10 
1 t^Oo ) , Roy^lci^^ (Roy, D. and Pentlan 
d A. Learning words from natural audio-visual inpu 
t, in proceedings of International Conference on S 
poken Language Processing, 1998, JUT, ~Xffi.2 b.^ 
do ) , ££WiSteels{cJ;3$8£ (Steels. L. Percept 
ually GroundedMeaning Creation, In proceedings of 
the International Conference on Multi-Agent System 
s, 1996, JiTF, Strnt^Oo ) t*|lf^T^5, 

[ooio] s/c, m<D (2) (DimmmcmLx 

ti, ^ = f->3> (imitation) KJ:St©, Jf&^ 20 
S (reinforcement learning) l£j;£&CX Evolutiona 
ry ComputinglC<fcSfeCD&if# s d5?>o 
[0 0 1 1] cnicKLTfi, DamasiolcJ;£fg& (Dam 
asio, A. Descartes' Error: Emotion, Reason, and th 
e Human Brain, Putman Publishing Group, 1994, iH 
T, &«4£:^9o ) ^MataricKiSffift (Mataric, 
M. , Sensory-motor primitivesas a basis for imitati 
on: Linking perception to action and biology to ro 
botics, Imitation in Animals and Artifacts, C. Neh 
niv and K. Dautenhalm(eds), The MIT Press, 2000, 30 

[0 0 12] LfrUfctfB, ±)£© (3) <D*fcnW»K: 

mzmmwrnimLxa, nmmcts^xmmc 

fV z.f-j7fj;h<Dt>m%-£nx^5rztfX*$ ) Z>o ^ 
[0 0 13] C<D±.m<D (3) <Dim?%>tC?>&, % 

fr*^McLxmmt%b\ ic&% 0 mtf^n*^ 
mts;<Dt>\ m}m.9k*<Dt>\ tt^f><D&<D*>\ mx$> 40 

(ground) f3fcttT*&<, n^y hgiOrtWDi 

xjf, primary emotion, secondary emotion^) ICS j§ 
tttt (ground) C ttf&nicKZo 

[0 0 14] ^lT% *H0^fi, ±T&<Dnmic&&xrj; 

sn/c 9, ^o^-r^v-r^ aife-iike) ic 

[0 0 15] 50 
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b&, iMommttmvttzrcibic, ammo-fin 
tLxmfflm'imzz&zimmm^mzffiz.Zo c 

mtLxmmmmftmzmmzo 

[0 0 16] Sfc, **f5n#7 KgBOt7S)*l 
<D J; 9 * p # >y h SBOff ®)3iW£?£lc ckt), utfvh 
[00 17] $fc, *58WK:«Snsj5*y r-gBli, ±2 

[0 0 18] Sfc, *lHt|5n*7 hSBOf?»IW 

Lxmmt&o 

[0 0 19] ZG>Jz.5ttn#y hStBotfiiSiJattrSK: 
[0 0 2 0] tit. *58Wfc««P*-y hSiBtt, ±$ 

mmmm®*7Mcm-3^xB®?z>3zmktiW 

[00 2 1] C©J:5*«JSfc«*.*n#*y h«Btt, 

mi<Dft®mfcm^x&ftvztitc&&ommmm 
m^TMcm^xftmxtimm^mczQmmL, 5% 
mxt>wm^mcoBmmicm~3^x, %mxt><Dmm% 

[0 0 2 2] ffc, *«lflfcff5DsRy hgfiOfTi)*!) 
±$©lfgi£$i£-f Sfc&K, STATUS 
%P\tjxmicx%:21nrcfm\tiZ, W&LtcU 

<Dmmmm<D®mmfcm-3^x&ftv-$nrzm.&<»mm 
mm&^TMcm-i^xmmtzftmxtimmjLm 
t. ¥&m\timmxmicxmrcmmmicm-3^x, %m 
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[0 0 2 3] £/c, .*JHflt««0!i?-v h&Btt, ±3S 

tf»iPJW*'raiiiij»*a%«A*o c©j:$a*Mg«i 
£-rs 0 

[0 0 2 4] Sfc, *«WC«*P*v hSBcDtTffi)$iJ 

frftffltt&Hjfc <fc 0 > • o h «lll4s i B©¥B*Hfe 10 
[0 0 2 5] *%ifc«5n*7 hSBti, ±a 

xm tr s kjh wrt a5ttt8*ssir s ^ asKJieaau 

fMMEWf «Ctt¥8t k ft** So 
[0 0 2 6] COJ: 3 p^-y hSSti, 

*HWtow»ia«nfe«Bc, «a*tifc««*icgi^<± 20 
[0027] sfc, *^t§5P*7 mmmmm 

EttfSiattPlSk^^-rSo c©J:5ftn*»Ha 

So 

[0 0 2 8] 

[0 0 2 9] Hffl©«IBt?tt, 9t?\ P#'V mm<Dffi 

[0 0 3 0] ( 1 ) *HS6cDJBffitc«t?.P^-y h^HtD 
0 1 ICS* J: 5 1» r *J l/fcJK«OVM3 

^K*tt€niW»a:=.v-r-3A, 3B, 3C. 3D*' 
l*S£ftSk«fc, y h 2©S(i»St;« 

^fc^n^n^a- y h ARXSmMU^-y h 5 #51 

[003 1] BB#SPa-yh2 K «, 02 {C^f* 9 50 
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tc, CPU (Central Processing Unit) 10, DRA 
M (Dynamic Random Access Memory) 1 1 , 777->i 
ROM (Read Only Memory) 12, PC (Personal Co 
mputer) A-hVV>-7x-XHBl 32fctflBWI 

SHlO»*Jftkb'T<D/<«yrU 1 7 k^iRi^$tlTV> 
S 0 9Efc, JPftgfla- -y h 2 tcti. D#y r-SS 1 <D|rJ 
*^#OipjW**ia , r*fc»Oft]MI[-by"9- 1 8S 

ti/raiss-ty+ri 9^kt>iK^$nT^So 

[0 0 3 2] gfc, WtUy h 4Ktt, n»Ottia* 
Jf^-fSfctfXDCCD (Charge Coupled Device) 

^2 ok, ffiffl«*^o r»-esj- j f».rnn<j tv^fc 

•yftyt2 l k, M#fcttB-r«ttrftg?0EK£M 
^■TSfcto©!gg6-t?y+r2 2 ftff8$&«-T«fc« 
<DV^^P^^23k, B|#^H©^^tB^-rS/ci6 
<DXt?-#2 4£, n#7hSU© rgj {cffi^fS 
LED (Light Emitting Diode) (HavSI") 

[0 0 3 3] Sfcfc, §Pgi5a-<y h3 A~3DOMIf5 
aKH«W»a-y h 3 A~3 DStf|fif*»3.-y_h 2 
©&SliS£g|5#, WM-V h 4Rt>*)Pftgi5n.- y h2<D 

^ktctt^n^nsss^oT^^ax-^ 2 5 . 

~25„ RtftfT^S/a* — £2 6, ~2 6. tflER* 
ttTVS. 0H*.tf> 7^faX-^2 5, ~25» 

*%fl|jSkLT*L,TV>So 
»(C<fcf>, PSPa--y h3A~3DAW^*nT, 

[0034] ^lt, cnsftatt-feytM 8, #n>ijs 

■fey-tM 9, *yf"b>-9-2 1, Sggi-tr >+r 2 2, v-f 
fnt>>2 3, Xt?-*2 4Rt5»*r->'>3^-*2 
6 . -26. ^kO^ffl-try-9-Mmc L E D&t>*&7* 

-2 5. a, ^nenwr sm7 

2 7. -2 7. ^LT3> hn-/WSl 6©fi^aa 
0SS1 4k^it$ti, CCD*^7 2 0M^yf l Ji 

7 «, znzftmm&mm 1 4 kBs^^nr^ 

So 

[0035] m^wm®%, 1 4«, ±a?o#-fe>u-^6 

d r am 1 1 n<Dmi£&w\mw&m-z>o sterna 
mm&i 4«, cnk«t/^fy 1 7^6«ie«n* 

C^DRAMl 1 fHcomfetiLWlcfeMtZo 
[00 3 6] C©«fc5tC LTD RAMI 1 (C^Stlfc 

^fl-r-^li, CCOftC PU 1 0#C©P#y h^S 1 
©«ffWW*ff 5 RRlCf Uffl $ n^o 
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[0037] hks±cpu i otis n#yvmmie>n 

777->iROMi 2{c&$$n/c$iJ®l7Wv2 i ;£:P 

c*-bv^^-7x-xiHissi 3*ftLxy.immm 

[0 0 3 8] ZTc, CPU10&, Z<Dm±m<D£ J HC 
ffi^®aiHl8S 14±DDRAM1'I f£j&MftlA2tlS£ 

«7-7^cs^TgERtf^ffl©W£\ ffifflta^ io 

cD^Rtfi&t )t>Ht©W*ftfc if So 
[0 o 3 9] CPUioii, ccoWt&TSSIIRtf 

DRAM1 1 \C^LtcW»yu^=7K{zm^Xm.<. 

T^fax-? 2 5. ~2 5„ £riBiJj£-£S d iifc J: 
r> % ffi%f>3L-y F 4^±y^Km^tc<0, MlSPa 
Z7h5 <0mM 5 A£»J#HJ-fc 0 , V F 3 A 

[0 0 4 0] £fc, COIRCPU1014, j&gtcfcCT 
^f-^mt, cn*M#^aiHl8Sl 4£ftLT 20 
W§5£ UTXtr-* 2 4 t#x.5C fete* 0 

pmmcm~3<%jz*nmcmt}2*irzK>, tmo le 

[0 0 4 1 ] ccDJ^KLTCOP^-y FSB l ki&V 

[0 0 4 2] (2) 9m7u?7l*W7 F7x7H§/& 
llT, P#«y FSB 1 tcfettS±i£©«iJffli^ , n^5A 
OV7hfi7l*H;, H3{c^fJ:5k:*S, C <OBI 30 
3fc*5l^T, fW- F^/'i • U-r-V3 0{i, CO 

F7^^645f'W7 • F5-f/<«"byh3 1 fr£ 

CCDA^72 0 (02) Jf»^-YvS!¥«0ji«<D3yifa 
-iitfflv^nSA- F7x7fcSjg77-trxi-5 c i: 

[0 0 4 3] n-ff-f'^-t-^-t^ii' 
F3 2(i, r^-YX- F5-f/*- U-<*3 0©JBTffiJB 40 

5. ~2 5. HO^-K^xTfcT^-bX-r SrcfetDi' 

■v;l/-D$7h33t, 8: if fcglirSV 

7F7x7g¥T'&5/W--7*-:-/>3 4 fc, fttOS^ 
iDWX- F7-l'/ i !?;fmV7h^x7i-eft§ 
T>U7s> F^-f A • V^-^-v 3 5 DjtfyFSEB 

i ©«»&wrsy7 h^xrafT-^Sx+f-ry f • 

a#>y F 3 6 tfrbmiSfetlX^Z. 
[0 0 4 4] T^-yt •t7->*x^h3 7lt ^"7*^ 50 
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x7 F • 3 8 RIM— • 3 9 

frbmfttetlT^Zo *7*^x7 F • V*— » 3 8 
Dttf-fy^ --9— ^-*7^x^h3 2, 5 Yll> 

• 7x7 • U-T-V4 0, RXfT-fVr-i/a > • W"V 

4 nc#£n3&v7F^x7$©jgim*7£ ! ga-f 

£77 F-7x7$?&D> U— If* • v*— » 3 9 
tt, **y*-K2 8 (02) (Cte^nfcn^^^a 
V7 7 Jl/K:Eifi£ftTVS&*:7S>x 7 F HQ&ttlft 
«£8-3V»T**7*S>x* h©s*6wr$v7 F7 
x78fT'$5 0 

[0 0 4 5]^ F^ "7x7 • U-T-V4 Oti, PJfi-r-r 
<y7 --y— A-^7^x7F3 2Q±{4«fcffiBL, IB 

fiwaa^s^fflasft^ocoa^y fsb i cog#w& 

^^JI^-r5V7F'7x78f^P.«/K^nTV>§. * 
fc, 7-7V*—>3> - WTiM 114, ^F/l"7x7 

• L"fiM 0©±ffiHfcfMU ^iiF/l'">x7- 
U-ft4 0*lStSSy7h'7i7Sli:J:oTEl* 
nfc«HU6£fcS-3^Tn#y FSB 1 <Dim*&mt 

[0 0 4 6]&*3, 5 K;l/« 7x7 • 4 0Rtf7 

7U7—>3>- W-V4 101M77h7x7M 

[0 0 4 7] ^ FVl/ • 7x7 • Ott, @4 tC^ 

bbsr^ sii^Hiffl, mmmms *v?~by*m. 
mz&mRV&mmmcD&mn&m^j^-frs o~ 

5 sMa'fcA^-fevy-TV^xpy/s— **^x— ;i/5 

9ftH*W.t5ffi»3S6 0fc, f±i7 t J-trvy7i'7XP> 

ffl, €-i/ 3 >BM ^ffffl, mmmm, led^ 

CTfflRtf^S^fflOSfi^ffiat^a-^e 1-6 7^: 

[0048] mm% 6 o ©&M*t$as€-^a -;f 5 0 ~ 

5 8ti, P#r-i"y7 •■<7-/ , !-^7>'x7F3 2<OM 
-f+;l"Dt;yh3 3(cJ:0DRAMl 1 (02)*^ 

jttty^-z^v^-bb 9tc4x.5 0 cct\ 

Atf, /V-^-wl/ • D,-}?<y F 3 3«, m^Oilfgm^tC 
[0 0 4 9] XTJ-tvyr-r ^xay^-^t^a-;!/ 

5 9«, c:ne > ^f^ffia ; ey*a-;i/5 o~5 8*»e# 
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i/ny- im--\m 1 (@2) ictitf]?% 0 
[0 0 5 0] 7-?V>r—>3 y • l it, msiz 

3. —)]/ 7 1 „ We^a-JW 2, ^1«^t;1/7 3RD* 
#^T*;W 4©50©^a-/l/frP>18$£nTI^ 

So 

[0 0 5 1] ^m^T^^Cfy^) 7 OtCte, 061^ 

ftZWlk-iLLrcfsW)*:?^! 0 , -70. tftSttP>ftT 
[0 0 5 2] ?LT, cn^im^T^TO, -7 0. 

(CISCT^^J: 9 Kfflifll tf/P 7 3 KfiSJSSttTVft 

[0053] <i(Dntfo<DBm<Dt§&, zim^T 

;l/7 0i -7 0. tt, %.<D'ttW)%ftfe-?&¥W;tLT, 
07^r«td* CKtS) NODEo ~N 

ODE, frP>ffecDifcD/-KNODEo -NODE, tc 
»$-f5fr*5y— KNODEo -NODE. (Cfa^g 
M-TST-^ARC, -ARC. (c^ur^n^n^ 

snfciw^p, -p. ics^^Tfis^wt^-rs 

So 

[0 0 5 4] Rittfyc, ^fTftt'T/l/ 7 0 i ~7 0 
. fi, *tt*ftga«0f"r» ; £'r;">7 0 , -7 0. 
"fSy-FNODEo -NODE, fc^-ftJFftjtfc&S-e 
T, cn&/-FNODEo -NODE. <:*fc{C08fc 

[0 0 5 5] COttflttU£~ft8 OT'tt, ^©y-FNO 
DEo -NODE. lc*5^TiI&£:#i:-f SA^^ 

[0 0 5 6] LfctfoT, B 8 (OKSUi^ 8 0 T*^£ 

n§y-KNODE.oo r,i-*-;i/%&aj cba 

LL) j fcv^B»MeStf5*.&ftfcJ§^K:. SKtSf® 
^hftt#^p,n5 J E-<D#-;i/© r*t£ (s i z 
E) j rofr^ioooj ©KBTfesct^ rpssti 

(OB S TAC L E) J fc^3KWS«*^*6 
$?<D mm. (DISTANCE)]*' TOA^IOOJ <D 50 
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[0 0 5 7] tf.1t. £<DS— FNODE.oo T'li, ^ 

-7 0. tfflWWfcfcWtSBHrefJW 3fttf4*** 
r;W 4tc^n^n«Jf?nfc§1t®)R0 : ^*cD^7 

is, {gist^-r^ 7 3 icfiatstifc rso* 

(JOY)J, (SURPR I S E) J gt<ti 

r?<6b^ (SUDNESS) J (D^tnfrCDA^t-i* 

r5o^e.iooj ©SEHT*fe5ttfcttfli!<oy-Ffc 

[00 5 8] £ fc:, tfSil&S 8 0 THi, TffecDy - F 

^\oywmm o«k*5»*« fj office 

©y-FNODEo - NODE. fr&jHTet 5y- 

T ^JM o i: * Jc ii» T* * « y - K N O D 
Eo -NODE. ^©jI^fit^Tb* rffi£Dy-F^©M^ 

y-FNODEo -NODE. {cW&t&fgACIjtflt* 

coa^«^j <Dmfc*sif%&ftcDm&<Dmt 1 oo 

[0059] Lrctfix, m8<Dfflm&m8o?'m-$ 
nsy-FNODE.oo T-tis &m$ r#->i*&m 

(B A L L) J U ZOtf-jMD TS 1 Z E (*t 

£) j # ro^eioooj ©WH^*5i:^d»3»ie£a' 
4^e>nfc^-&fc{± > r3o [%] j «dw4st ry-FN 

ODE.zo (node 120) J TA 
CT I ON 1 J <Dt"f»7bTO?n^Cti:*?)o ~" 

[0 0 6 0] ^-ff 7 o , -7 0. ^n^n 
c © <fc 9 ^«!ia^g 8 o t Lxtmz nrcs - f n o 

DEo - NODE. *V<OfeRtf3«k$fcLTfllJ# 

5 vfrzmm&wis-x.'btirztzitZK:. w^-r^y 

-FNODEo -NODE. ©t^ffiS^S^fiJffl LT5I 
[00 6 1] 0 5fC^-ftf!^&*v":i-;l/7 ltt % t"r 

ii^er y 7 o oy^tjfh^f^ 7 o . - 7 o . 
^{aoiSt/^TSi^f*^ 7 o > -7 0. ^etij^^nfc 

cin^Tiinv>Fi:i^o ) *5 F;l/ • 9i7 • 

W-V4 OCDtB^-trvyf-'f ^3>/?-^->a-;I/ 

6 fcfcV>TTWfc'fiE£tt;fc : ff»*rrt' 7 0. -7 0. 
[0 0 6 2] Sfc, fifi)«)^^a-;l/7 H±. ff»^ 
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JW.^ts^yy-'i ^^y^—^^'J^.— )16 8fr 

m*-7 , ;v7 4ica»i , r*. 

[0 0 6 3] -73, ¥1*^1-^7 2«, Xtl^y 

i^Mcoo^, n?iwftj -»f> ran* & tut j an, 

-So 

[0O6 4] ^LT, m^-;P7 2(i, CCDfggS 10 

vjzfyv 7 oic&ifzw&rzimtTtn o > ~7 

0 n ©Mt5IW^IIt5„ 
[006 5] ffiT?, Ii€f;V 7 3 fi, HSftf (jo 

y) J > r^gt* (sadness) J , Hgt> (anger) J , 
r»t (surprise) J , mm (disgust) J Rtf H8 

n (fear) J ©£tf 60©tii»j£O^T, §1S»il*i:{C *20 

E[t + l] = E[t] + kexAE[t] 

[0 0 6 8] fcfc, ^KiWSS^a^-bvyf -i ^xn * 

*fit©gi«AE [t] te£©gfi©»»g:#*3jWi 

[t] {cA#&SJ§£4;t, r»T'P»n/cj kv>ofcB 
BNSm» Wj ©1f»©/^-*ffi©^i«AE 
[t] te*$fcf&W£#*£«k5{<:&oT^3o 30 
[0 06 9] CilT\ tliAf7yf^^X3y^-^€ 
S/"a-;l/6 8*»5©ji3?Ifctt, SfT$)©7-f-K 

Ttssiiifcgfcs-es. cna, r«*sj t 
v ^ rcff ii f c «fc •? & o ©sit ^/wws i/ ^ tz ck 

7 2{CfcA77$ttT*5'?, ¥B*5>a-,/W 2tt, ^© 
&»]fc:*-3^"Cfif» ; fc'r>l/7 0 . -7 0. <D*tfc?%m 40 

[0 0 7 0] &*3, ff»IS*07-f-K^'y^ti, fTlll 

Wai/-^7 i©m^3 G8*tf#4osnfcfT») 

[0 0 7 1 ] -73, *H&efVW 4 TOSttft (exer* 

1 [k + l] o I [k] + ki x A] [k] 
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5 9*^#^.p>n§ rnpfrn/cj raree>ftfcj * 

[0 0 6 6] *f*Wfctt r rtWtT^W 3W\ ATJ-feV 

0 sub 2 n§ ?<d t %<D*<Dffi ww^mmz a e 
[t] , ffiEozomno'^ [t] , * 
o«n!io«a**-r«a* k, tu, (Distil 

T*Ofl)Ht43tJS*OW»©/^^-*fflE [t + 
[t] fcH*aAS«fc5KLT J C-©Wi|0^7P«-*«[ 

x±x<Dmmv»*> c 7*-zmitm.m-tz>o ~ 

[0 0 6 7] 

[ftn 

... (i) 

cise) J , rglfg^ (affection) J , (appetit 
e) J TkXS r§f^D (curiosity) J ©Sl/HC&iELfc 4 

W-ri'^XnyM— ^^ei/i— ;l/5 9 ft & 

[0 0 7 2] #A£&x/U7 4*4, rs®j 

-;l/6 8^P)^D^i^^:^^^cS■^!v^Tm^^D^S^S(^:«}:»7 

aao*©a*0'^>{-*tt* I [k] , ^<D8)!5fcO 
««**-r«»k. i:tT, BfSHffiT? (2) #£ffl^ 
T^OiSW^fcttS^^O-'^^-^ffll [TT+ 
1] ^StBL, c©8dMS**RflEO*oacRO/<5^ 
[k] fcBfr»AS«fc9lcLT*0«#0^7 

[0 0 7 3] 
[ft 2] 

• • • (2) 



[0074] £33, mm^mRifihtj^yf-^ ^3 50 
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^-^fCtSilAI [k] icKZK&WZS-X-Zko 
iC&oTt^o 

[0 0 7 5] *^WO«IBfCfeV^Ttt, 

TV>?. 0 10 
[0 0 7 6] -7?, 5 F;l/ • £x7 • U-f-V 4 OCQtftfj 

4 1 ©friiwtft^a— >w l^e-^^ns 

So 

[0 0 7 7] * LXCtlZmmBmtVa.-frG 1 ~6 

^2 5, -2 5, (0 2) fc^-*S^*"9— jRffi^li 
Jf», Xtf-^2 4 (02) *>5Hi*t5fOfPf-* 
rgj £DL E Dlz$-7i%m9)}7 : —5<Z±l£Ls 

3 2£D/^-f-+;b • h 3 sRxfm^mmffi 1 4 

(02) £li#:frLT*^T37??-aX-*2 5. ~ 
2 5n XttXtr-*2 4Xt±LEDfcre*3ilffl"r So 
[0 0 7 8] cOJ:5iaTn*7hSIll:^T 

[0 0 7 9] (3) n#7 hgi^PlOlffl 

[0080] ( 3 - 1 ) v'XxA^jlcDMS 
$fcf , IRnnS^V^WM (Emotinally Gounded Sym 
bol Acquisition) ^IISTf 3 v^-f AJftjaOffifg^Itt 
BOTSo 40 

[00 8 1] CilT\ ft-f, S^f^fcWSS-rSfcfcfc 
D«T®ISIB*«iBU *flB^jiffl LfcS/XxAT'li 

(life-like) ftps*? h«B©fS8i*Bo"tV 
(Req- 1 ) BfgaH#fT»*£©J: 3tc osK-y h££B 1 <7> 

(Req- 2) I^KlWilv'^tfOl' (Emotionally Grounded S 
ymbol) ££©£?tcLT#lJ£-f 
(Req- 3) HttfffcfcttSBMWftft%H©<fc3fc*r 50 
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(Req- 4) P#-y bgR 1 £ A<&lfflT?ir©«fc 9 fc LT> 

ip)DW^»ca«^ii6 9^o -r&fc^ (sh 

ared Attention) ©HJHfcifdlSPSWSaN, 

[0082] tuio* a fcft-f |g|&&JIjBt,;fco Jt-f, 
(Req-1) fc»LTH\ WiWirW]^^^ (Ethologi 

cai Model) ic^^mm^tmmmM^>^>m 

t# (Physically Grounded Symbol Acquisition) ©7j?S 

[0 0 8 3] CHX\ UmftW&ft^Ttl' (Ethologica 
1 Model) JCfcSSBfrWlfeStt, «H*.fcfArkin£©«S 

(Arkin, R.C. , Fujita, M. , Takagi, T. . and Hasegaw 
a,R. Ethological Model..., submitted to ICRA-200 
1> JJTK XiK6fcV^o ) ^BatesOlBS (Bates, J. 
The nature of character in interactive worlds and 
the oz project. Technical Report CMU-CS-92-200, Ca 
rnegie Mellon Unversity. Oct. 1992, IXf, £1*6 t 

[0 0 8 4] $fc, 1ttim^y^;I4M9 (Physically 
Grounded Symbol Acquisition) <D~fi'&\&, #J*J£, ± 

[0085] ^Wim<D\-Dt\,xmmmt^ 

[0 0 8 6] CCT% U-^Xfi»li, hgl 1 

[0 0 8 7] ^eic, ±j£<D (Req- 2) ©ffifftRia^V 
401/ (Emotionally Grounded Symbol) (cRjLTli, ; €" 

[0 0 8 8] *fc, (Req- 3) tcKbTli, W^^T^P 
^ (Perception) T'fgi, (Categorize) 55lMtLT 
ttffiLfcfeSS©*f-=f7-r-lf- (Categorizer) fc-tT 

[0 0 8 9] 3>ea-*-rtK«assnfcfi 

(Virtual) *taWT^?nTV>SEl-Nasr6<D«i 
ft (El-Nasr, M. , Loeger, T. , and Yen, J., PETEEI : A 
Pet with Evolving Emotionaly Intelligence, in pro 
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ceedings of InternationalConference on Autonoious 
Agents. 2000 % MT, $M8t^?o ) V&^XtBmt 
tlXl^ Synthesis CreaturtOJSWi, D#>y h^B 

*VV CO* 9 (Req-3) fcHLT 

tt> (Perception) <OA-r dT^^if- (Categorize 10 

r) t LTtimftttfbts. zzm^xmm bfc 0 

[0 0 9 0] ±xE© (Req-4) <0#|^aiW>P«giH£KIL 
Ttt, COWfttfrKi^W^r^ (Ethological Model) 

[009 1] HtSISHcfetJ55/y*;WaW (Symbol Acq 
uisition) •CEg&^fCShared Attention (&P£fe 
SO ^Wijoint Attention^ V^btl^ &<D#&5o Bru 
ner©$?S (Bruner, J. Learning how to do things wi 20 
th words, in J. Bruner andA. Carton (Eds.) Human g 
rowth and development, Wolfson College Lectures, CI 
aredon Press, 1978, UT, S0^9t^o o ) lc£V>T 
(4, ftPi&flt (Shared Attention) (4, ttJSO^SjSS 

[0092] c<D£?%nm&Mtt, Wiwm^mty 1 

J\/ (Ethological Model) VfrWi&BHDty^ hZttM 30 

[0093] j-xt> s-tssjk, wm®^<m$i (Et 

hological Study) %#*l/fcfT»«l» (Behavior Cont 
rol) fcHLTlBM*K»Wrrs. Wffim*<0 

®tt®wo&ffi£ lth:, ±$©£iK 6 *we>n5 0 

[0 0 9 4] «££tt^frfc1»$SHff§fTlfr£ 

40 

[009 5] (3-2) nW»J»i:rtW«IBfc»j8af* 
It (Fusion of External Stimuli and Internal Variab 
les) 

WMT^^Tfr (Ethological Model) fcfctt^fi 

(Motivation) ^fcftW*J»fr&©5«KSM» (Releas 
e signal) fi^ft^n&ifcffPffi^n, iTijffPffiffi (Be 
havior Value) £&Mlc9m'3lf (fusion) i: 
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& **:tx2y Xf7»)££/£-r 5 C £ IPC Z 

[0 0 9 6] BI9tc«, hZimicKLX, ttfotZft-i 
TV>5o 01 0K«U ^*S/Xff 

[0 0 9 7] B9fc-3V>T, StefHft (ingestive) © 
«^*WCi|8tfTKWr*. W^aVtUW (Mo 
tivation Creator) 1 0 1 (i, Qm&m<OftWRW**> 
WMfW}^^— i/a yfll (motivation value) £i¥ 
fitTtB^-TSo -73, 'J'J-^^^-XA (release 
mechanism) 1 0 2 (i, WttrWHcVm? ZfttMffiKu 
mXlf* tMtf&ftlX*<Ommm<0%l?tm^ (releas 
e signal) ZmffiLXttit)? % 0 % LT> tf-^-S/g 
y|t (motivation value) t D 'J— Xfii^£W±ft]Mfl! 
*f (release signal) fcttafifcWfflSnTl^S. 

[0 0 9 8] tfiliWffiSP (Behavior evaluator) 1 0 3 
tHi, ^f-^— ->gyi (motivation value) tVV — 
7>m^ (re lease signal) t^ffffiLT, CVftWi^O 
t>(D<DWmm*ftmmmm (behavior value) tLXtii 

{CfriftfflWB (behavior value) *tH¥.U f£3$T3fr 
ftSftft (Action selection) fcHtfj-f 5„ tr»3S«?gP 
(Action selection) & o t kig^!¥ffi£:4x./c 

[0 0 9 9] CCT\ tf-^-i/ 3 >£fiRgB (motivati 
on creator) 1 0 1 fcrt»«fl!tfa£fc«5Hfr& , f ttfc 

[oioo] 0-3) mmmmiyy^i'mnomm 

(Emotionally Grounded Symbol Acquisition Architec 
ture) 

1tK)llia^>'3p;l/aff (Emotionally Grounded Symbol 
Acquisition) {CfeD, g^Tift©— SPt: LT£Q*ftKQ 

(Emotionally Grounded Symbol Acquisit 

ion) w&ffiito<D-&tLxmi2ti&m]&&. mz. 

(4*0 l ZlCTntko&Mf&fc&Zo c<Di/X7-hffimz 

(i) *to\tifrW$\t>fr*m\x*z>& : i-* y*fr 

(ii) *f-vy*;i/©*f-=f5d'X©tS**rt8HS980 

(iii) rt«M^fc^»i|8j»©IMWt»^Wt'r/I/ (Eth 
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ological Model) tCjfcSlfro'o 
[0 10 1] &±&i/7. J rkfflttK.l3ti&$'<yhK.1t 

(Etho logical Model) \C&%>***7.$ is7> 

[0 1 0 2] £fc» *^^Jgfflt.TH^L/c1fi)Ml 
i/y#)\/W& (Emotionally Grounded Symbol Acquisit 
ion) Tit, Z<Dmm&ft®tfMV)®frttLXWmV 

yamMMi/yXfrffiH (Physically Grounded Symbol A 10 
cquisition) <B£oTV& 0 

[0103] <kd&?k, mmmmisyt^mm c&»t 

ionally Grounded Symbol Acquisition) "Cti, ftfi^ 
(c'WIbnS (Emotionally Grounded) HH8$HgftttT 

. (Action) *T*^**»*U U-^^*-Xi» (Releas 
e Mechanism) TiWf 5<1 ££f>J6E£ LTVSo 

[o 1 04] mvm<nmtzttm>t<Dmmc 
j&^x'wssMtLrnoct-e. ^nm&oxtitfm 20 

Tj^nfci:^, MW%£Mfrt> 2%lffiWi (secondary emot 
ion) lcE1M.LX&%<iHffiWgi (internal variables) 
©SEfcfcUtfjU ^ttlcj: 0 2 #1f»j<D£$£-t 3 c: £ 
tffSo 0>J*-fcf, Stf^SttfciffclMBl (emotion) 

[0105] cntccfco, ^^aftctiLMi 

[0 10 6] (3-4) 1flfi®t#tf®) (Information Ea 30 
ting Behavior) 

&mm<D~&t Lx<r>fflm®'n®*mit%tctb 

[0107] mtf, mmmmmv-fwrui., % 
<Dmnmm%&t>\ mm^m^^xtucnLx^m 

terns iz®im u mm 1 1 1 k s * 5 
m&rfrtLxm&tZo cvmmwmmvyyxT 40 

Ic^tStf^-^ay (Motivation) ££/£-f3<, 
[0 108] CiO^lCfe^T, UU-X** 

zXA (Release Mechanism) ti, A* (WfB> 
CD&<DT*&tUi"'J U-7.{g*f (release signal) 

mm (fusion) t tracts c £#r-t 5 <kd£& 

So 

[0109] mmmnftmtLxmmztizmwtti&fi 50 
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[0 1 1 0] COsfcdft^r^WKe-rsctfcJ: 
®(DWc&mcMtb&is<lttfX' ! 2Z>£olcfrZ 0 t% 

t>^>, u#'y.vmMucts^x&ffim£\sX$mzti 
x^myzvti/s yemv^mmt LT-flrtawffr 

[0 111] (3-5) &Ir)£eIc (Shared Attention) 
i/ Xf A (Delete Shared AttentiontfcWiJoint Attent 
ion£g$fcfrfc^fcLTffi#&£ttT<,>S. i'XfA 
fltitKfc^T, «Ett«lcS"3<1**!»# (Informatio 
n Eating) ©ff»I»4JJlT©J: 9»C^|fT?n*. 

[0 1 12] ±aS©<fc5K:rtaEK!Bi:^afi|»J»i:<0H3i 
(fusion) fc«fcDli&£^tTifttf?T»S&Sfl (Acti 
on selection) 1 1 6 lc<fc OHJRSnfc t?%> 0 

[0 113] U U — 7,*i]-Xk (Release Mechanis 

m) i o 2#u y-^wsifl-riBHfcfttjfcjWWW 
m&f£if& e> c coff w^wrs titc t-r n« „ s^*Mt 

ttPIiilc (Shared Attention) CD£— - >y h- (C& 
[0 114] a # y h 

B l *<D*-y>y hfcifi^t, U "cnii 
feP)9i:i:{Cj;!3±t|^^ (Shared Attention) 

[0 115] -73, a— W±**%fi^TV^S«^, 
■T^:t>^> U'J— X^*-XA (Release Mechanism) 

^{Ct3V>T*>, IHlCW^cWtTCDjtlsJttic (Shared 
Attention) A^filc^n^o 

[0 1 1 6] COi^C, *%B^T'«, y 7.x AtC a 
Si5t LT^ISiaiC (Shared Attention) %JRQ&/oX^ 
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So 

[0 1 1 7] (3-5) ftt&tmmtt^m (INTERNAL 
VARIABLES AND EMOTIONS) 

01 2fc7jrf £9*C, !§1S§|5 (Emotion part) 1 30 
tt, ^?<MT, &j£ffirtgW$iS5 1 3 K rt&Kflg 
95 1 3 2 RtfttflMB 1 3 3 tfrZm&ZftX^Zo 
[0 118] 10B©rt«|EK»»l 3 2tt, rtgPRH* 

©fc©©^* ^7.£W3f satfi-e&So ::w 

JWfi&*jWWH«K:*»kLT#ftLTV^* (0 2 10 
3) „ fcJEU CtlBOrtSEKJUt, ±»t/cfi(C 4 
14jXttil»fc:aStt6ti*«!l©rt«seK!|-e*oTtJ: 
V. figPttligfl 1 3 2 tt, *©{ltt&&{c&gfttf^& 

y^JESSP (Motivation Creator) 
[0 119] 20l©to*fflrt»ttffitt 1 3 Hi, figtf 20 

V^Ttt, Wttraft£f*&if*«J£U jIM^tDJ (Acti 
on) fcfir? C fcT«flXWKrtaP«ll*-^fC«Ofc46<D 

[0 12 0] 3-o8<DmW)&l 3 314, ftffiXM<omt 30 

1AM (eiotions) *£j£"r*IR#T*&5o C©1SKjg|$l 

•3 3ti, 2^w»tt>i»tfn, rt^ifift (cn*i^i 
m%.im<Dmm±]& i P*tifctt!&?2> l e d©^ 

[0 12 1] cortBICK!l©afttt, 0 l 2tc*Vf<}:-5 40 
til, ^gffl (Associative Meiory) 1 4 0©fS 

fi, rtSMflitf *£ < £fb Lfz t * fcft -5 v * 5 c t X 

&s. rtatKJifcfliiftwaiktt^n^nfTW (Be 

havior) fedcgfl©^^— ^ a >£/£g|5 (Motivation C 

reator) icx^n, *n^n©fT»»«©ieHi: lt 

[0 12 2] (3-6) *»I^<0*PM (PERCEPTION F 
OR UNKNOWN STIMULI) 

mwftfctevzvxy bmm \ ©bssek^t mm} 50 
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»hr*3ft»***ftiBii**i;*. 

[0 l 2 3] 3fi*f, CCD&of&l&mOft&lClS^XX.Z 

Kimzwx^z^mtLx. mm^-ytm est 

atistical (or probabilistic) Pattern Classifieatio 

n) tffc*. etui, ft^lStfrnTtSArtl^TVl/ 

©/^*-**#i&*BWi^ffiT?*a. ttS-rsABB 
i$ i: L XmtE±m 1 1 tlX 1/ > m i dden-Mar kov-Mode 1 
(WT> HMMkl^,') t>C©«W©i8liTOl** 

[0 12 4] #^*rixT*«u ^©ttttW' 

[0125] fm^^-ymmxH^ *7i>x.9h& 
mm. < , c ©^ + y*>wmxm\mmm&^x 

[0126] ( 3 - 7 ) SWtfBHSnS^Bffl*^ y 
(ASSOCIATIVE MEMORY WITH EMOTIONS) 
^Sffl^t'J (Associative Memory) ti, 

(Perceptual Channel) ©Hl^Cj: 0 rt«ER|R*< 

-t^nfc^gimffi©^fbi:, ftmrnzgitsarc, 
[0127] lct% nzm&vmm. m%.it±M<o 

r (3-5) rtgPt«c8l^{kt1tt!l (INTERNAL VARIABLES 
AND EMOTIONS) J K^XW^-fc -fe «^J!P*f 

Atf»fiF«nfc0»3Sfc:j:9fts*nst©-e, w* 

[0 12 8] ^tLTCi, AUK^-ir (Percepti 
on Channel) i}^'M l btlX< S^n h (prototyp 
e) ©^^©ynh*^:/ (prototype) (c«?5B8 

**^tt***fe tic, isii«E*cri>s**©etff»r 
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tyMW^i/ytf-fr (Physically Grounded Symbol) 

[0129] zibic. mmic bvjs-t*z>ft®vm 
ctic%% 0 c(D£?%¥m*mmmmi'yx>\' (Emot 

ionally Grounded Symbol) <D3fi#&C&3 0 
[0 1 3 0] CCX\ 1f»J (Emotion) tit, M&Wfc 

im®ttm<Dmt?&zrctf> i xmmmznz&cDx io 

ttfTZZrctb, SW&iffc&Mitttt (Grounded) $ 
41^5/^4-01/ (Symbol) X&% 0 

[0 13 1] (3-8) -^v/XxARmTH) (SUBSYS 
TEMS AND BEHAVIORS) 

tT»{i, hi oizTiit &ot*ftmnmtemL<D'im®£ 

^nS+rT'i-'Xf-A (subsystem) 1 1 5i ~1 1 5« 
icm^XMWZftX^&o trT'v'XxA 115.-1 

i5.ii> mmm&x-h^^)^m^^-o^<oxh 

[0 13 2] ®mf, ±$©£8K6k:TArkin?>ftW 
UTV^i)W7il^©OT^(c*3V'>T, canny behavior t 

«6tCT^?nTl^S$RcO!|t®«, 01 nc^-rj; 

fy->Xf A© 1 OT'S^RStTltl (Investigat 
ive) £1H$8£^3, «^^T»)i:LT£eLT^3 
d^feS, #Rtf, mMftM (ingestive) t^^V 
T'v'Xf Ati, (fttO t^vfimt 

Lxjzmzftx^Zo cftic&K>, mm&iicit^yfv 
-mmttftfflvmt lx, ztiz&z>®mftfcU-D£o 30 

t5^-i/3> (Motivation) ^4^5 £ ttfoi 
[0 13 3] ^XxATHi, Z.<F>£*)ts.m%.-fiii:W& 

mnnxT v fias^xmx u ^v^moms t lx 

LT#ft-rn«\ ^ntc&ifiLT, }§*SU "what is 
this? (cttfiffl?) " fcv^friifcU 3MiA#5S 

§i9lCt5o ClT\ ¥H«tt> fflfctf, *©¥B*t 

mtWPtz&sictzmitmx-hZo so 
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[0 13 4] £6fC> tLJ«*0«lll**Hlfctf, 
rtasKffifctt LT if© J; 9 fcjtffttf 

m (action) tpimmmtzmm^-tz: t^sc 

[0 13 5] (4) mSODsK-y r-gfi'\CDjSffl (1MPL 
EMENTATI0N) 

( 4 - 1 ) 4 Jg^iSOPtf-y r-gB©HI3I (Enhanced 
Four-legged Robot Platform) 

±M<Dis*T htf-mz ntc 4 femmo p # -y -tgs 

1 fcOV^TittWrSc 0 1 3K«, P#«y r-SB 1 
j«i:LTfB*fc*'y b7~ Jr^^AO— «**LTV^ 

[0 13 6] C©*-y b «7— f ->Xf Ale &^T\ a* 
y hSB 1 IRUAL A NfflA- F (wireless LAN car 
d) 1 6 1 *m^Z£tlC ^<0s TCP/IP (Transmi 
ssion Control Protocol/Internet Prorocol) <D~fu h 

[0 13 7] P#>y h-SB 1 tt, fllfctf* MIPS R4XXX© 
^1 0 0MIPS<D«Mt*ftOC PUfc 1 6MBO^l'y^ 

l£, ttJ^JtbTpriinitive behaviors (basic posture t 
ransition, to search an object, to track an objec 
t, to close to an object, to kick an object, to ea 
tan object, etc) mvMfit S V7 r- ")i7 £%MM 
^5iJ«:A*fcf *Speech©*r^x^ h (object) 
iS^T^So Sfe, Pt^hSlKi, gt»l5f5L 

[0 13 8] CO±9SD#7 hS§nc43^T—±xE 
l/i:J;94^fiW?ftTt50, P#<y h^S 1 

[0 13 9] 2 COJ:daa#yhSlll«««a 
->3^1 6 3±fc^V^Tt.P#-y hS« l KfettSiffla 
«kt», 7-^Xf->3y 1 6 3±K:fcV>T, P^-y h 

%o 7-7Xf->3y i 6 zi.iz&^x'im.itVioWi 

[0 14 0] P#*y hSB l tt, X*ttH«MS^**+ 
7*f-+- (capture) HKUL ANffl*-K 16KC 
<toT, liLAN (wireless LAN) ^/rLTH^ 

1 6 2icmmtz>o t lt> a® 

ti, 7^-feX#-f>h 1 6 2*»6-T— r- (ethern 
et) (.%t&&m ^LT7-yXf->3y 1 6 3tc 

[0 14 1] i:7c, CCDcfc^^P^-y h^BlA^7- 
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p#>y mm i Kfe^sHWftfitttt^^-yf-feyy- 
iojig-by-y— miczz-ty-V- *tti1IHItf7-* 

±?ic9-^f->'3>'i 6 3^cfc-V>T$!!.Ji■t3*§-a■ 
^^^i, *tBUTtto#v h*B 1 <Dv-r?£<$fc>-f 
{<:, y-^Xf-i'ayi 6 3 0T-<^T'A^-rSil^ 

[0 14 2] 7-^Xf->ayi 6 3±T'tt, 
■^(DA^M^ffl^TiiBcDPerception. Evaluati 10 
on for internal variable, Behavior subsystem, acti 
on select ionHSrUfff 5o Ctt «*fcfLi 
.nux±fcH«*nfcO P E N - R (y--«^Cfttt3WI 

<y b^gft^C^KOPEN-R^iyx? b (OP 
EN-R objects) SrKtrU *tl6***y h7— ^±-pi 
itctS^f SCfcTHJS^nSo WfcfcT, Stft&Matlab 
yp^AhOPEN-R objects on Linux<DiH£-?fMf £ 

[0143] (4-2) nmommtmm&m (impiem 20 

ented Functions and ExperimentalResults) 

So ftttflfycfi, o^-y h^H Hi, 0 14 fc^f J: 5 
fc, ABULT, gifti Uf7 7*S 1) , nmn<D\ 
tl (Xx<y7°S2) KtfffttSlR (Xr-y7S3) Kg 
K*»A,T, «|p|aic{C<}:5ltW#tfil!) J f 

®mmmftW)*mmz&?^%> uf-^s 4) . *l 

T> D^hgllli, E<DJ:-5&&a»*S»1t!!KD 30 

[0144] (4-2-1) teMSP (Perception Par 
t) 

@i OfcTfit&olc, l Hi, Dt:7hSH 

(HIM9 1 2 4 t, gfcfcUrrsWHlfca 1 2 5 i: 
[0 14 5] JlttWfcti, 6ftlMg|5l 2 2MU 40 

•'*©g*#*f*fT 5 0 , * fc, 1 2 

12 d 2 
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[0 14 6] $fc, ftftllftljftlSl 2 4t4, P# 

rc v^»$ s mm-t y-o-fr zombie «t otww^os 

[0147] (4-2- 1 - 1) giftA^— t^f^yf- 
-yay (Automatic Color Segmentation) 

fefcffl^fc* 7-* * yf-y 3 yfflanmwiezkh 
ic3s^T9£?ftt>ti% 0 *7-cWyf->3yt* 

— > 3 y L¥S»c «fc s * 7 x * u y ?7>u 

[0 1 4 8] 01 5fctt, AlWfc!&ofc*:^x*h 
(0fA) tO*7-feW>f-fayO«« 
(0* (B) ) ^ITi/^o 3:/^ 01 6fcW\ AH3 
©^*3tye«8ii«, A©a£S€fg*SB« (0(PA) 

tzoyti?— btftyf—yByvmrn (0>pb) 

[0 14 9] CCT% ArtB«H\ J*«ttSK^«»ft(5 
3 x 41 Jt)(D7j^7cfc0 ^Xri^fl) A2»'HtKHteU» 
pass filter£>1988 x 60 pixelsfCig<h£ft/cfc£>T* 

fes 0 cin^#it(-An, t^yf-ya yitmm 

(pixel) Wc$6iZ:Lfc«ia^T'fToTV^o 
•pfc-f SiltT 5 , 0 1 5fpBRl/0 1 etpBtc^Ti? 

[0150] stc, mn. *>3-*.9*y7—*/ny 

tt, R G B^HiMLfcRG BSia^ff ?C**^ 
#;<7<Df§*§#Y, Cr, Cb7*-V7ht'fe 
SCc^f., (Nr, Nb) = (atan(Cr/Y) , atan(Cb/Y))© 
2^F^MictSo R G B^HIk: Wf SRfc 

[0 15 1] **5, d(D«fc9**7— b^>f- fa 

[0 15 2] 1-XT^ ±a«D*5HrW>f-J/3J' 
tcfeltSi'^X^U^^cDT^rruXAcD^axr-yy 

( i ) ~ (Vi) <DWt7T<?o 

[0 15 3] Xf77 (i) Tftt, jiS^IS^yPb^ 
^7 (prototype) ^-JiKiEB'f 3 0 

[0 15 4] Xf77 (ii) TI2© (3) S^rSg 
(ifcLTt^TOIBRtcWLafeificl/^^P h*-T ^ (pr 
ototype) '\CD7 77.7^;l'?r'OltSo 

[0 15 5] 

[S3] 



d = 



hue 



hue 



O 



sal 
2 



(3) 



[0 15 6] CCX\ ohue, osatti> 01 7lC7S<tJl 50 



■5 tc, ^ tl? tlhuei:saturation{c*HS"r S^Tfe 
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fctf)T*&D, — flgico hue<osatT*&3 0 -f&t>^ hu 

[0 15 7] Xf'^y (iii) T'ti, tLf^Ph^ 

[0 1 5 8] Xf7^ (iv) T'tis HC^^X^^VO 
[0 15 9] ^f'^ (v) Tti, feL20«±©yn 10 
[0 1 6 0] Xf7^ (vi) Xlt, 7oh*f:/0{M 

[0 16 1] &*5, 01 8tcte, A^BHifctt-f 
^*U>y©tt?=&^L/TV^. 01 8 Kjjrf0!lTHi, 

lft©«HJi:*0®fiWU:lc*S»{*:©SiJ#aib*?ToT 
^5«£*3*LTV3o 09*.fcf, il<D*att, &ifi<D& 20 
Haii (Shared Attention) Klfcl^T^fflSftSo 
[0 16 2] (4-2- 1 -2) SMt (Shape Analys 
is) 

SfrflT (Shape Analysis) @4E<Dfi]|1tft 
MT'fe§7-UxIBiE? (FD) fcffll^fToTVS. 08 
£<DMft1fiKl8^X. *f3*7^Xti, Fourier 
Descriptor©^ (6 4&7G) T©L2/;W»:&ffl^So 

«r^*«6ftjE'r*. 0i9tc«, \L>?*y 30 
f— 3 yxw k> m $ ixrcVsvwBViftffi (D&mzm u 

[0 1 6 3] (4-2-1-3) fgfSIO (Speech Rec 
ognition) 

UlSig^s (Speech Recognition) tlTHMMSffl^ft 

mwmmmmzm^x^% 0 

[0 16 4] £10J/XfA(i, 02 Ofc^-f $ 
*A^ai?l 7 K JilSOHMM^li^fcHMMU^^ 
1 7 2, *ftf§A*JfflHMM 1 7 3RtFJt«Wl 7 4* 40 

[0 16 5] HMMl/v'X^ 1 7 2©HMM(i > B#l§ 

SSttTt^S. Sfc, HMMUS>X* 1 7 2©HMMfc 

snti^o ccr% Miitf, satsn-cvsiswisi 

ArtStlfcSHWRMtt* COi34HMMl/y7^ 1 7 
2<DHMM(Ci3V -, TfilflJS:£ LTffHBStl*. 
[0 16 6] *551i§A^fflHMM 1 7 3tt, *»ilf 50 
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©fc&<9HMMT'&£ 0 CO*3BeA*fflHMMJL7 3 

it, 02 nc^fi^tc, itOSJUtf^^f-h 

JP^A^lfflHMM 1 7 3*4. 0 2 1 fc^-f <fc ? {C, "bo 
uruu" fcV^«ffiSA**^Sn/£»^{Cti, "booru" 

[0 16 7] A*SnfceSI«5iJtt, RfCfiOft^ttX 
f§Snfc#ffi©HMMi:, C<D*5spjiA»fflHMM 1 7 
3i:fcfel^TIMSSn*3bV fiiffijg (verifi 

cation value) ^ffl^Tl^CV-yfL/cHMM^OE 
ftWtKWl 7 4Cfe^Tffffi«n«, fLT, SIMS 

(verification value) tf*StfUJLhT?&ftfcf*9a£» 

1 7 2©HMMi:l,TgSi*ttSo 
[0 16 8]CT^LT, H MM W7^% 1 7 2^, HM 
MtLT> "tomare (stop) " i: "kere (kick)" 

o 2?<Dmmimm-ztix^&t><D<Dfr*^t%m-&ic 

■o^xmmtZo 02 2(c&, coJ:?4i/XfA%ffi 

[0 16 9] 02 2(C*3^T, fcWtCfiSSUT&SJIi 
fgtCtt-tSA^t^OBifiJt (verification) 0>te&^ 
LT</">5<, fcfc, C(DBimM (verification) <Dtelti& 

[0 17 0] 0*Rtf, "tomare" fci/^fgsSfcfcf UT> 
~>7.xA«\ " tomoare" fcV^^gg^JcDA^T'fcS 
fc«I^U ^©Bifi^ (verification) (OmtQ. 136T? 

[0171] -73, 02 2tc*5^T±fr?>3#g<D" bo 
oru (ball)" fcV^*3BS§OA^3K:WLTtt, 
•t'T/Wi "tomare" ^©fiSffJt (verificatio 

n) «4.835i:^{cAt^^c46unknown-li:l/^ifH/'' 

v'X-fAH;, #|I|cD#£fSA;rjT-fe50 2 2{CfcV>T±fr 
P>4#g{c^-T "bboru (ball) " tOfgfSA^fcttLT 
unknown-He *fJ&t" 5 H MMtf g t> jfi < , -f (DStM 
g (verification) li0.4l£'h£'l/MI*fc 0> IEL<un 
known-KC^O" booru (ball) " tfSffSnSJ: 9 Kfc 

[0 1 7 2] CKO^-rATte, HMM*m 

©BflltfRlg&fcii), 02 2lC*5l/>T±frP>7#g<Ofg 
K<0«fcdfC" booru kere" fc»U JtfcJiWLfc^-boor 
u" (c^f S^^l/unknown-HC^t^, kerefct/''? isy& 

[0 17 3] CCO^aftRaSBWOS/XxAtCioT, 

[0 17 4] (4-2- 1 -4) (Emotion Par 

t) 



(16) 

29 

0 2 31C&, fig&tWi (Internal Variables) RV^tl 
lc m&f 3 fiW} (subsystem) ©H3$£^ LTV5<> 
[0 17 5] COHTftt, R^tTlllKD^a^-r^if 

©Bf]WI«rrtfilcyaii:UT3£8bT^S. *n&tt, 09 
K.tfEnergy-2 (gfttitftk Fake Food) (D»£Fake mt 
ft (excrement) <DHT?&3 0 
[0 17 6] fliRfcf, H2 4K5^J:5fc» <RSto*JS 

(mmmftm^77) tmm#i%®mMm mm io 

[0 17 7] H2 3K*-r«kdfC» fe5SHT'lii)P^V^ 

i/a y£l£Sl5 (Motivation Creator) ©S^WftlWf 

JC-fStfilSP (subsystem) Otf^-i'aV (Motivat 
ion) *±tfSC tfcftSo 

[0 1 7 8] £fc, JI<HW (Fake) *ft«K>*tt±i:U 20 

TdjK'V hSB 1 ©JRIgtt (Entertainment) ©SWtC 

«Mnergy^«»lc«a^*rttttt««fe#ftLTli> 
£ 0 eft St 13 2 3 {c^-riiin, M'>gBK:<i:»?:?V:r 
5^X%«J«U JMfi-rStf^S'Xf-Z* (subsystem) 
O^f"^— S/a y^fiJtSP (motivation creator) l±Cft 

«7»^ LT«3B-r S J: -5 *a»^Wrftt,#A 
[0 1 7 9] $fc, jS&fBttfCg^ftSlSffiKfc^T 

saw***™* asuEttortaJit nmitmtat 

3*X'1b%t>\ ]S»%H*UT!S:<Tfea^. iH^^RS 

A4>ft»fc*lJSLTVS. 40 
[0 18 0] (4-2-1-5) ¥WB**U» (Asso 
ciative Memory Part) 

02 5fc«. mm. i ^*«»#tffiffl-rs¥B 

ffl^U (Associative Memory) 1 4 0©ft(*W**lfi8 
$ctITI^&. ¥Bffl**y 1 4 Ote, 02 5lc;KfJ: 

je)WH**y 181, fijwffl^tu i 8 2Rt>*a 

1 4 0&, mftmclt. 01 2fc^-TJ;9{i:CSK.?,nT 
[0 18 1] ^Sffl^D (Associative Memory) 1 4 50 
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0«, C<D&0%.mmz&*), &%&t&Z>BX\~D<D 

[0 18 2] JSHBfEUffl**'.) (Short Term Memory, 
S TM) 18 1 tCfcl^T, m&ft<D I DS^fttttkftfc 

•fuhf-Cfm^ (CP-i) £Jg«<D7Pr-*^7#^ 
(SP-j) ©IMBT&So $/c, JSJWffl^tU (Short Te 
rm Memory) 1 8 1 (Ct^ ffMOafrg A*)£ft£ 1 H 

e^omn^j^x^ s fts 0 
[oi 8 3] ja**f»6©7*-*tt, fe©yph^-rys 

^ (CP-i) K.TSBVUDfuhZ'ffm^ (SP-j) ^A^l 
fcLT, mW<D%M (HMM-k) fcrtflSRH^OKff (Del 
ta-I) *f|T, cn6%0-fc$4:»kSnTHl 21C^ 
1~<k?fC> fr®)£fi5cgfl (Behavior Generator) 1 5 01c 

m<bnz> 0 tu ynwv&ifo (HMM-k) trtacw*^© 

Kff (Delta-I) Wf^n^l/^tt, (ni 
1) tffB£LTiIP>ftSo ^Kx-^tt^Ot^tTSl* 
fiScSP (Behavior Generator) 1 5 OlCjl^tlSo 
[0 18 4] —75, fri&iilRSfl (Action Selection) 1 
1 6fc43^TffS) (Action) tZOltimtW (Obj-ID) 

y (Behavior State Machine) fr&^SflMtU (Asso 
ciative Memory) 1 4 0 fCiMP>ftT < 5„ C(Dl$Wfafo 
(Obj-ID) fcWlS-rSWWtt, MHffi^'J (ShortTer 
m Memory) 1 8 1 frib&mttmm*^) (Attention Ob 
ject Memory, AOM) 1 8 3fc&rjf5Sft5<, * 
<Dfct5®JWffl**l> (Short Term Memory) 1 8 ltcA 

'J (AttentionObject Memory) 1 8 3 lc3MP>ft&o 
[0 18 5] ffittttUlMt'J (Attention Object Mem 
ory) 1 8 3fr£#5fccD^f?fl3^U (Associative Mem 
ory) tLTmmtZmmmt^V (Long Term Memor 
y) 1 8 2fC*tf5^S©*^>?"W\ rtSBttSl^t: 

(Object) {C*fr?,fe57^^3 >*LTV^S|RKrt* 

[0 18 6] (4-2- 1 -6) fir®j£f£gP (Behavior 
Generation Part) 

l*<Do%<D&mmft®V7i/*Tl*lC-O^X$lWt 

[0 18 7] tTilW^^XrAKcio^y^h^x 
Tt'/i/j.^Y (software object) tf^&fSo 
[0 18 8] u©V7F')i7*^xi'h (software 
object) Otf-^— 5/3 y^fiicSP (Motivation Creato 
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r) 1 0 Hi, ±3£<D 1 #W(W2M#jI^&SBBfr * 
loWWtW— >a>I (motivation value) tftii 

MC_va] = 1 - tanh (lnt_val) + e 



[0 1 9 0] -73v V V— Xtio-XL. (Release Hech 10 
anism) 1 0 2 (4, ^Iffl^^'J (Associative Manor 
y) 1 A0i)^m^X<^nma (Object) 
Ci:(c<fcoT*Sn§ 0 'J 'J-X^-Xi* (Release 
Mechanism) 10 2T*t4, Sl&**P©kcD, tAfSiC^ 
ZfgZUcmtZtoit (release) H^*#SibT^ 
uCT% 0Uf4\ $3]MB?{4, «*» (Object) © 
(ObjlName) > Color©^M (Color:Name) , Shape 
<D%m (Shape: Name) , (Object) cDflgftK 

ffigfc'xcD^g (Act:Delta-I) T'&£ 0 

[0 19 1] UU-X^A^XA (Release Mechanis 20 
m) 10 214, JOlt&ffcLTlS&nfcfcOfc:, 1f*B© 
£«#&SftTt*fcttttlf U *iB^ (Release sign 
al) *iiJHJ-r«o *LXs 'J 'J-X^rt-Xi* (Releas 
e Mechanism) 1 0 2 fcWjTS 'J U— (release 

signal) <Dffit4, l-3©J***tcWLTO*««oa 

zmntrchot Lx^^mm^n^nxm^nx 

«*%©*lW (Obj:Name) fcrt«B«lS« 
(Act:Delta-l) <Dfr*ttmtt%£ £&X' 

[0 19 2] -f-LT, UU— X*tl—Xk (Release Me 30 
chanism) 10 2IJ, &&LX^%ttWSlCttLXV 'J 
— (release signal) *ffHiU ^©ffi^fife;*: 
*»JWMfc*«RLT, ^OiHRtfcjW* (Obj) * 
■WSTSIDfcy U-vMSMt (release signal) *Hi;rjT 

[0 19 3] 0fla.tf, ftftWfcLT'Jy=fjW5£bfc* 
ntf-y hSB Ucti, ±i£Lfc«k 3 

T, fcflSB^fcLTOCoIorOfcffi (Color:Name) , Sha 
'pe©45ilj (Shape:Hane> *ffffif 5« »J >d"*^»Sa 40 
'*nTV*J:3fc*frfcfcJ\ IHH&WSv^kOfcfcl/C 

t# e> n c ntc ct d u > =f I?* s c 

n& 0 ^lt, *©a«ufci«iHBt«ti%y^=f*«f 

SfSIDi:*©k*©y y-Xffl^ (releasesignal) 

[0 19 4] — 2n y 'J— 7.*i]=-XU (Release Mech 
anism) 102&. AISfcJ:SJSS UcBBl/Ttt, -5 6 
(cA^^yy-^®^ (release signal) %±J&t2>£ 50 
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[0 18 9] 
[«4] 

... ( 4 ) 



dtciS^^nrv^o f LT, yy-7.^*r:XA (Re 
lease Mechanism) 10 2li, J§i§UC«k3!|WM&tfJjb< 

*Hc^t>e>Ty y-Xfg^ (release signal) 

lt^So ens, mzLtfmzfricAmfrzmmm® 
<$.\,mmmwm<Dm$.x& o > rtwtttifc a * < 

So 

[0 1 9 5] fit, 1ffgSt#ff»)-9-XS/XxA 1 5 1 
. Xits ilO'JiJ-Xif (release signal) fcf*-"* 
— v'ayfil (motivation value) i:*^Pbfct<0*tf 
WffHffiffi (behavior value) £b-n#6 0 £fc, R^tC 
bT, Eating^^S-rSflSO^^^Xri* (subsys 
tem) tCfc^Tfe, 1f|g?»t#ffi/)-9-X^XxA 151, 
IcAtlZtltcV y-XM# (release signal) 
->3>l (motivation value) fcfcffll^T, fT»)j¥§j 
fit (behavior value) 3H#S 0 

[0196] *i/t\ nmmm^i 1 6(c*3v>t, 

X^X-rA (subsystem) tfh<OViWM^^ (behavior 
value) *ifc«U 5 1, A t&frifjtMSffi (behavior va 
lue) %So+f7>'7fi« (subsystem) tf^rf 
^XTA£bT3HR$n3o cccTSHWCtt, dOJ: 
a &fffl5«©Jt«K: «fc 0 , « ®mWfi®V7i'X7- h l 
5 1 . iC^SfTi/jfHffiffi (behavior value) #gA£ 

[01 9 7] &*5, jg^n/c+rXiyT.xA (subsyste 
m) (4, LI^<lffltf5W$5^, iint4, fiSJ 
*J4\ ffiSWiM^gS&KH (fatigue factor) ft^fcj: 

[0 l 9 8] fllffliaiWfilU-^^Xr^ 1 5 1 » #£JR 
£n££u 02 6lCit4 9ii:> F (Mode) M 

Dfci*tfnSS[*tJi€ro *— H (Mode) MDT'«\ |B) 

F (Mode) TH4, ±(ft«©a!!R^}iS btc 45», 

C©*— K (Mode) MD{C*3V>T, EBU*^Sn§ 
0 2 6lc^-TJ:9{c, ^©T^i:$ni.t^a-;l/ 
(Module) M J t^t>tl&miC*S^X, mW&}&'i7W}lC 

ffii i 6fcfev^r, ^w^ffweaw^ftsn*. 
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[0 19 9] CftKitK cupy hSBltt, mz.lf, 
(ObjtNaie) i: flgMKfiSfb'NOf^ (Act :Delta-In 

t) tr'zmm<Dmwmmti^nrz^a^ 

7,Th (subsystei) <Dt Z. 3T*ftAfltI¥ffi£^;lfctt 

[0200] aBfrft^nfT-rs^oiaafc io 

P#<y r-^B 1 «, ABAMS-PS Lfe«9(**tSKW* h 
^v*^ (Visual Tracking) J&Latffcifi^** ^. 

[02 01] KWRV^m (Obj :Name) omWftWtS 20 

tij (Obj:Name) ©St#<Dfcto©Xx- h Vv-ytcj^n 
3o *mM<T>%M (Obj : Name) <0^#tri6t*5VTfi, 
*©»*»tWLTaHtWh7y*>^ (Visual Track 
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CLAIMS 
[Claim(s)] 

[Claim 1] Robot equipment characterized by having the behavior control means 
to which it is robot equipment which carries out autonomous action, and 
information acquisition action is carried out as 1 action of autonomous action. 
[Claim 2] Robot equipment according to claim 1 characterized by the 
above-mentioned information acquisition action being the language acquisition 
action which gains language as information. 

[Claim 3] It is robot equipment according to claim 1 characterized by the 
above-mentioned behavior control means carrying out the above-mentioned 
information acquisition action based on the homeostasis of an internal state by 
carrying out autonomous action based on the internal state at least. 
[Claim 4] It is robot equipment according to claim 3 characterized by making the 
above-mentioned information acquisition action express when it has the 



information acquisition model which makes a parameter the information 
acquisition avarice as a change factor of the above-mentioned internal state and 
the above-mentioned behavior control means becomes a threshold 
predetermined in the parameter of the above-mentioned information acquisition 
avarice. 

[Claim 5] Robot equipment according to claim 4 characterized by the parameter 
of the above-mentioned above-mentioned information acquisition avarice 
changing with time. 

[Claim 6] Robot equipment according to claim 4 characterized by the parameter"" 
of the above-mentioned information acquisition avarice being what shows a 
feeling of starvation to study. 

[Claim 7] Robot equipment according to claim 4 with which the parameter of the 
above-mentioned information acquisition avarice is characterized by being the 
amount of information acquisition. 

[Claim 8] Robot equipment according to claim 4 with which the parameter of the 
above-mentioned information acquisition avarice is characterized by being the 
amount of study of new information. 

[Claim 9] It is robot equipment according to claim 8 characterized by making the 
above-mentioned information acquisition action express when less than a 
threshold the above-mentioned amount of study is the amount of study which 



decreases with time, and predetermined [ means / above-mentioned / behavior 
control ] in the above-mentioned amount of study. 

[Claim 10] The behavior control approach of the robot equipment characterized 
by carrying out information acquisition action as 1 action of autonomous action 
of robot equipment. 

[Claim 1 1] Robot equipment characterized by having a semantic acquisition 
means to acquire the semantics of an object. 

[Claim 12] It is robot equipment according to claim 11 characterized by gaining 
the change of the above-mentioned internal state when carrying out action of as 
opposed to [ are acting based on the internal state and ] the above-mentioned 
object in the above-mentioned semantic acquisition means as semantics of the_ 
object concerned. 

[Claim 13] It is robot equipment according to claim 12 characterized by gaining 
change of the above-mentioned internal state detected by the above-mentioned 
internal-state monitor means when carrying out action of as opposed to [ have 
an internal-state monitor means to detect the above-mentioned internal state, 
and ] the above-mentioned object in the above-mentioned semantic acquisition 
means as semantics of the object concerned. 

[Claim 14] Robot equipment according to claim 1 1 characterized by having the 
associative storage means which associates and carries out associative storage 



of the semantics of the object which carried out [ above-mentioned ] acquisition 
to the object concerned. 

[Claim 15] The behavior control approach of the robot equipment characterized 
by gaining change of the above-mentioned internal state when the robot 
equipment which is acting based on the internal state carries out action to an 
object as semantics of the object concerned. 

[Claim 16] The robot equipment [claim 17] carry out as the having-voice-input 
means, two or more word sequence description model [ which were classified 
based on the characteristic quantity of the word sequence at the time of 
speaking ], utterance input evaluation means [ evaluate the utterance input 
made by the above-mentioned voice-input means based on the 
above-mentioned word sequence description model ], and word sequence 
specification means specify word sequence of above-mentioned utterance inputs 
based on evaluation value of above-mentioned utterance input evaluation 
means description The above-mentioned utterance input evaluation means is 
robot equipment according to claim 16 characterized by having the characteristic 
quantity detecting element which detects the characteristic quantity about the 
word sequence of the utterance input made by the above-mentioned voice input 
means, and the evaluation section which evaluates the characteristic quantity of 
the utterance input which the above-mentioned characteristic quantity detecting 



element detected based on the above-mentioned voice description model. 
[Claim 18] Robot equipment according to claim 17 characterized by having a 
model registration means to register the utterance input concerned as a new 
voice train description model with the characteristic quantity of the word 
sequence when evaluation of the characteristic quantity of the utterance input 
which the above-mentioned characteristic quantity detecting element detected is 
low. 

[Claim 19] The above-mentioned word sequence description model is robot 
equipment according to claim 16 characterized by having the characteristic 
quantity of the word sequence acquired by phoneme study. 
[Claim 20] The behavior-control approach of robot equipment of carrying out as 
the having-utterance input evaluation process [ of evaluating the utterance input 
made at a voice-input process and the above-mentioned voice-input process 
based on two or more word sequence description models classified based on 
the characteristic quantity of the word sequence at the time of speaking ], and 
word sequence specification process of specifying word sequence of 
above-mentioned utterance input based on evaluation value which acquired at 
above-mentioned utterance input evaluation process description. 
[Claim 21] Robot equipment characterized by having the control means which 
carries out behavior control indicating the study object of self in the robot 



equipment which carries out autonomous action. 

[Claim 22] Robot equipment according to claim 21 characterized by having the _ 
control means which gives priority to the object specified based on the external 
stimulus, and is made to act as a study object. 

[Claim 23] Robot equipment according to claim 21 characterized by pointing to 
the study object of self as action which shows curiosity. 
[Claim 24] It is robot equipment according to claim 21 which is formed in the 
appearance configuration imitated to the animal equipped with the leg at least, 
and is characterized by the above-mentioned control means carrying out 
behavior control which points to the above-mentioned study object by the 
above-mentioned leg. 

[Claim 25] The behavior control approach of the robot equipment characterized 
by controlling action of robot equipment so that the robot equipment which 
carries out autonomous action points to the study object of self. 
[Claim 26] The evaluation section for consciousness which is robot equipment 
which carries out autonomous action, and evaluates the input signal from the 
sensor which detects an object, and the above-mentioned sensor, With the — 
internal-state Management Department which manages the false internal state 
which the evaluation result of the above-mentioned evaluation section for 
consciousness is inputted, and changes based on the above-mentioned 



evaluation result Robot equipment characterized by what the change and the 
above-mentioned object of the above-mentioned internal state based on the 
detected object are related, and is memorized for the above-mentioned storage 
means when it has a storage means to memorize relation with change of the — 
above-mentioned internal state based on the above-mentioned object and the 
object concerned and an object is detected. 

[Claim 27] Robot equipment according to claim 26 characterized by having 
further the emotion section which generates a false emotion based on change of 
the above-mentioned internal state, and memorizing the emotion related 
information based on the above-mentioned object and the object concerned for 
the above-mentioned storage means. 

[Claim 28] It is robot equipment according to claim 26 have the action generation 
section further, transmit the 1st signal to the above-mentioned action generation 
section when the above-mentioned homeostasis is confused, while the 
above-mentioned internal-state Management Department manages the 
above-mentioned internal state so that the homeostasis of the above-mentioned 
internal state may be maintained, and carry out that the above-mentioned action 
generation section generates the action for maintaining the above-mentioned 
homeostasis based on the 1st signal of the above as the description. - 
[Claim 29] Robot equipment according to claim 28 characterized by carrying out 



associative storage of the action for maintaining change and the 
above-mentioned homeostasis of the above-mentioned internal state to the 
above-mentioned storage means. 

[Claim 30] It is robot equipment according to claim 28 which the 
above-mentioned internal-state Management Department has an information 
acquisition desire variable, transmits the 2nd signal to the above-mentioned _ 
action generation section based on the value of the information acquisition 
desire variable concerned, and is characterized by the above-mentioned action 
generation section generating information acquisition action based on the 2nd 
signal of the above. 

[Claim 31] The consciousness evaluation process of evaluating the input signal 
from the sensor which is the behavior control approach of the robot equipment 
which carries out autonomous action, and detects an object, The internal-state 
management process of managing the false internal state which changes based 
on the evaluation result in the above-mentioned consciousness evaluation 
process, It has the storage process which memorizes relation with change of the 
above-mentioned internal state based on the above-mentioned object and the 
object concerned for a storage means. The behavior control approach of the 
robot equipment characterized by what the change and the above-mentioned 
object of the above-mentioned internal state based on the detected object are 



related, and is memorized for the above-mentioned storage means when an 
object is detected. 
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DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the behavior control approach of 

robot equipment or such robot equipment. 

[0002] 

[Description of the Prior Art] In recent years, the robot equipment with which the 
appearance configuration was formed in animals, such as a dog, by imitating is 
offered. This robot equipment acts like an animal according to the information 



from the outside, an internal condition (for example, feeling condition), etc. And 
there are some which carry out action of kicking a ball in such robot equipment. 
Furthermore, there is also a thing equipped with the learning function in such 
robot equipment. For example, a language learning function is mentioned as a 
learning function. 
[0003] 

[Problem(s) to be Solved by the Invention] By the way, one ultimate target in the 
robot equipment of a pet mold is constituting LIFE-like (Life-like) robot 
equipment, if this puts in another way - an opening en — DITTO 
(OPEN-ENDED) - it can be said that a system is built. 

[0004] It is bringing close to the target to constitute LIFE-like (life-like) robot 
equipment from how conventionally complexity is increased and shown. 
Elements, such as study and growth, are also taken into consideration in it. 
[0005] However, the mounting has realized the probability of the probable state 
machine set up fixed because of action generation by modification or exchange 
of the whole state machine by strengthening study. 

[0006] The generation frequency of action and its pattern change with interaction 
with a user or the external world, and although the complexity which robot 
equipment has is increased, they do not exceed the action and the reaction 
which the designer (programmer) assumed first. The object whose recognition is 



similarly enabled by robot equipment is made restrictive, and, thereby, cannot 

recognize the thing except the programmer having set up. These mean lacking 

the capacity to determine how it acts to a strange stimulus. 

[0007] the opening en exceeding a setup of a designer — DITTO 

(OPEN-ENDED) — it is the following things that it is the need in order to make a~ 

system. 

(1) Capacity that a strange stimulus can be recognized (2) Capacity which acts 
as the ** student of the new action (3) When it is taken into consideration to the 
capacity pan which chooses the suitable action to a strange stimulus that it is 
robot equipment of a pet mold, especially the capacity that carries out interaction 
with human being is important. Also when learning various strange matters, it is 
the fact which is learned through interaction with human being in many cases. 
[0008] It is the communication by language which becomes the most important 
in interaction with human being. It is thought that it becomes the 1st step to 
acquire the identifier as suitable categorizing and its symbol (Symbol) or to 
acquire the identifier of the action about the capacity to recognize an 
above-mentioned strange stimulus of (1). Although this is an area of research 
called so-called language acquisition, it is pointed out that it is important to have 
associated especially those symbols physically or to have grounded (Ground). 
[0009] Can come, and if Seki is carried out, for example The report by Kaplan (IT 



Kaplan(s)) F.Talking AIBO: Firstexperimentation of verbal interactions with an 
autonomous four-legged robot.ln it is called reference 1 proceedings of the 
CELE-Twente workshop on interacting agents, October, 2000, and the following. 
The report by Roy and others () [ Roy, ] [ D.and ] Pentland A. Learning words 
from natural audio-visual input, in proceedings of International Conference on 
Spoken Language Processing, 1998, the following, it is called reference 2. Or 
the report by Steels (it Steels(es)) L. Perceptually GroundedMeaning Creation, Irr 
proceedings of the International Conference on Multi-Agent Systems, 1996, the 
following, it is called reference 3. It is mentioned. 

[0010] Moreover, about above-mentioned action acquisition of (2), there are 
what is depended on an imitation (imitation), a thing to depend on reinforcement 
study (reinforcement learning), a thing to depend on Evolutionary Computing. 
[0011] It is related with this. The report by Damasio (A.Descartes[ Damasio 
and ]' Error: Emotion, Reason, and the Human Brain, Putman Publishing Group, 
1994, and the following) it is called reference 4. The report by Mataric (it 
Mataric(s)) M., Sensory-motor primitivesas a basis for imitation: Linking 
perception to action and biology to robotics, it is called reference 5 Imitation in 
Animals and Artifacts, C.Nehniv and K.Dautenhalm (eds), The MIT Press, 2000, 
and the following, etc. - it is mentioned. 

[0012] However, about the suitable action to an above-mentioned strange 



stimulus of (3), the very primitive thing is only reported in the real world. Or there 
are only some to which some relate in the imagination world. — 
[0013] The place which this above-mentioned (3) means is about what kind of 
semantics that body has to robot equipment to gain [ how ]. For example, it is ** 
about whether it is fearful in whether it is food and whether it is a plaything. It is 
necessary to associate a recognition object physically for that purpose, or to 
affect the inner condition of robot equipment how it not only to to ground 
(ground), but, or to relate (ground) and to change into inner conditions (for 
example, primary emotion, secondary emotion, etc.). 

[0014] then, this invention is made in view of the above-mentioned actual 
condition — having - more — LIFE — being -like (Life-like) - it aims at offering the 
behavior control approach of the robot equipment brought close and such robot 
equipment. 
[0015] 

[Means for Solving the Problem] The robot equipment concerning this invention 
is equipped with the behavior control means to which information acquisition 
action is carried out as 1 action of autonomous action in order to solve an- 
above-mentioned technical problem. Robot equipment equipped with such a 
configuration expresses information acquisition action as 1 action of 
autonomous action. 



[0016] Moreover, the behavior control approach of the robot equipment 
concerning this invention carries out information acquisition action as 1 action of 
autonomous action of robot equipment, in order to solve an above-mentioned 
technical problem. By such behavior control approach of robot equipment, robot 
equipment expresses information acquisition action as 1 action of autonomous 
action. 

[0017] Moreover, the robot equipment concerning this invention is equipped with 
a semantic acquisition means to acquire the semantics of an object in order to 
solve an above-mentioned technical problem. Robot equipment equipped with 
such a configuration acquires the semantics of an object. 

[0018] Moreover, the behavior control approach of the robot equipment 
concerning this invention gains change of an internal state when the robot 
equipment which is acting based on the internal state carries out action to an 
object as semantics of the object concerned, in order to solve an 
above-mentioned technical problem. 

[0019] By such behavior control approach of robot equipment, robot equipment 
acts based on an internal state, and gains change of the internal state when 
carrying out action to an object as semantics of the object concerned. 
[0020] Moreover, in order that the robot equipment concerning this invention 
may solve an above-mentioned technical problem A voice input means and two 



or more word sequence description models classified based on the 
characteristic quantity of the word sequence at the time of speaking, It has an 
utterance input evaluation means to evaluate the utterance input made by the 
voice input means based on the word sequence description model, and a word 
sequence specification means to specify the word sequence of an utterance 
input based on the evaluation value of an utterance input evaluation means. 
[0021] Robot equipment equipped with such a configuration evaluates the 
utterance input made by the voice-input means by the utterance input evaluation 
means based on two or more word sequence description models classified 
based on the characteristic quantity of the word sequence at the time of 
speaking, and specifies the word sequence of an utterance input by the word 
sequence specification means based on the evaluation value of an utterance 
input evaluation means. Thereby, robot equipment specifies the inputted 
utterance as optimal word sequence. 

[0022] Moreover, the behavior control approach of the robot equipment 
concerning this invention The utterance input evaluation process of evaluating 
the utterance input made at the voice input process and the voice input process 
based on two or more word sequence description models classified based on 
the characteristic quantity of the word sequence at the time of speaking in order 
to solve an above-mentioned technical problem, Based on the evaluation value 



acquired at the utterance input evaluation process, it has the word sequence 
specification process of specifying the word sequence of an utterance input. By 
such behavior control approach of robot equipment, robot equipment specifies 
the inputted utterance as optimal word sequence. 

[0023] Moreover, the robot equipment concerning this invention is equipped with 
the control means which carries out behavior control indicating the study object 
of self in order to solve an above-mentioned technical problem. Robot 
equipment equipped with such a configuration carries out action indicating the~ 
study object of self. 

[0024] Moreover, in order to solve an above-mentioned technical problem, the 
behavior control approach of the robot equipment concerning this invention 
controls action of robot equipment so that the robot equipment which carries out 
autonomous action points to the study object of self. By such behavior control 
approach of robot equipment, robot equipment carries out action indicating the 
study object of self. 

[0025] Moreover, the robot equipment concerning this invention is equipped with 
a storage means memorize the relation between the sensor which detects an 
object, the evaluation section for consciousness which evaluates the input signal 
from a sensor, the internal-state Management Department which manages the 
false internal state which the evaluation result of the evaluation section for 



consciousness is inputted, and changes based on the evaluation result 
concerned, and change of the internal state based on an object and the object 
concerned in order to solve an above-mentioned technical problem. 
[0026] When an object is detected, robot equipment equipped with such a 
configuration relates the change and the above-mentioned object of the 
above-mentioned internal state based on the detected object, and is memorized 
for the above-mentioned storage means. 

[0027] Moreover, the behavior-control approach of the robot equipment 
concerning this invention has the consciousness evaluation process of 
evaluating the input signal from the sensor which detects an object, the_ 
internal-state management process of managing the false internal state which 
changes based on the evaluation result in a consciousness evaluation process, 
and the storage process that memorize relation with change of the internal state 
based on an object and the object concerned for a storage means, in order to 
solve an above-mentioned technical problem. By such behavior control 
approach of robot equipment, when an object is detected, robot equipment 
relates the change and the above-mentioned object of the above-mentioned 
internal state based on the detected object, and is memorized for the 
above-mentioned storage means. 
[0028] 



[Embodiment of the Invention] Hereafter, the gestalt of operation of this invention 
is explained in detail using a drawing. The gestalt of this operation is robot 
equipment of the autonomous mold which carries out autonomous action 
according to a perimeter environment (or external stimulus) or an internal state. 
[0029] First, the gestalt of operation explains the configuration of robot 
equipment and explains the application part of this invention in robot equipment 
to a detail after that. 

[0030] (1) As shown in the block diagram 1 of the robot equipment by the gestalt 
of this operation, while considering as the so-called pet mold robot of the 
configuration which imitated animals, such as a "dog", and connecting the leg 
units 3A, 3B, and 3C and 3D with front and rear, right and left of the idiosoma 
unit 2, respectively, the head unit 4 and the tail section unit 5 are connected andL 
constituted by the front end section and the back end section of the idiosoma 
unit 2, respectively. 

[0031] As shown in drawing 2 , the control section 16 formed by connecting GPU 
(Central Processing Unit)10, DRAM (Dynamic Random Access Memory)1 1, a 
flash ROM (Read Only Memory) 12, PC (Personal Computer) card interface 
circuitry 13, and a digital disposal circuit 14 mutually through an internal bus 15 
and the dc-battery 17 as a source of power of this robot equipment 1 are 
contained by the idiosoma unit 2. Moreover, the angular-velocity sensor 18, an 



acceleration sensor 19, etc. for detecting the sense of robot equipment 1 and the 
acceleration of a motion are contained by the idiosoma unit 2. 
[0032] Moreover, the CCD (Charge Coupled Device) camera 20 for picturizing 
an external situation to the head unit 4, The touch sensor 21 for detecting the 
pressure received by "it strokes" and the physical influence of "striking" from a 
user, The distance robot 22 for measuring the distance to the body located 
ahead, LED (Light Emitting Diode) (not shown) equivalent to the microphone 23T 
for collecting alien frequencies, the loudspeaker 24 for outputting voice, such as 
a cry, and the "eye" of robot equipment 1 etc. is arranged in the predetermined 
location, respectively. 

[0033] Furthermore, Actuators 251 -25n and Potentiometers 261 -26n for free 
frequency are arranged in the joining segment of the joint part of each leg unit 
3A-3D, each joining segment of each leg unit 3A-3D and the idiosoma unit 2, the 
head unit 4, and the idiosoma unit 2, and the list by the joining segment of tail 5A 
of the tail section unit 5, respectively. For example, Actuators 251-25n have the 
servo motor as a configuration. Leg unit 3A - 3D are controlled by the drive of a 
servo motor, and it changes in a target posture or actuation. 
[0034] And LED and 251-25n of each actuator are connected with the digital 
disposal circuit 14 of the control section 16 through the hubs 271-27n 
corresponding to various sensor lists, such as these angular-velocity sensor 18, 



an acceleration sensor 19, a touch sensor 21, a distance robot 22, a microphonS~ 
23, a loudspeaker 24, and each potentiometers 261-26n, respectively, and direct 
continuation of CCD camera 20 and the dc-battery 17 is carried out to the digital 
disposal circuit 14, respectively. 

[0035] A digital disposal circuit 14 incorporates sensor data, and the image data 
and voice data which are supplied from each above-mentioned sensor one by 
one, and carries out sequential storing of these through an internal bus 15 in the 
predetermined location in DRAM11, respectively. Moreover, a digital disposal 
circuit 14 incorporates the dc-battery residue data showing the dc-battery 
residue supplied from a dc-battery 17 with this one by one, and stores this in the 
predetermined location in DRAM1 1 . 

[0036] Thus, each sensor data stored in DRAM11, image data, voice data, and 
dc-battery residue data are used in case CPU10 performs motion control of this 
robot equipment 1 after this. 

[0037] CPU 10 stores direct read-out and this in DRAM1 1 for the control program 
stored in the memory card 28 or flash ROM 12 with which the PC Card slot" 
which the idiosoma unit 2 does not illustrate was loaded through the PC card 
interface circuitry 13 at the time of the first stage when the power source of robot 
equipment 1 was switched on in practice. 

[0038] Moreover, CPU 10 judges [ after this ] the situation of self and a perimeter, 



the existence of the directions from a user, and influence, etc. from a digital 
disposal circuit 14 based on each sensor data by which sequential storing is 
carried out, image data, voice data, and dc-battery residue data to DRAM11 as- 
mentioned above. 

[0039] Furthermore, CPU 10 can make the head unit 4 able to shake vertically 
and horizontally, can move tail 5A of the tail section unit 5, or makes it act by 
making the required actuators 251 -25n drive based on the decision result 
concerned to make it walk by making each leg unit 3A-3D drive etc. while it opts 
for the action which continues based on the control program stored in this 
decision result and DRAM11. 

[0040] Moreover, in this case, CPU10 generates voice data if needed, by giving 
this to a loudspeaker 24 as a sound signal through a digital disposal circuit 14, 
makes the voice based on the sound signal concerned output outside, or turns 
on, switches off or blinks above-mentioned LED. 

[0041] Thus, in this robot equipment 1, it is made as [ act / according to the 
situation of self and a perimeter the directions from a user, and influence / it / 

) 

autonomously ]. 

[0042] (2) the software configuration of a control program - here comes to shotfr 
the software configuration of the above-mentioned control program in robot 
equipment 1 to drawing 3 . In this drawing 3 , the device driver layer 30 is located 



in the lowest layer of this control program, and consists of device driver sets 31 
which consist of two or more device drivers. In this case, each device driver is 
the object allowed to carry out direct access to the hardware used by usual 
computers, such as CCD camera 20 ( drawing 2 ) and a timer, and processes in 
response to interruption from corresponding hardware. 

[0043] Moreover, the ROBOTIKKU server object 32 With the virtual robot 33 
which becomes by the software group which offers the interface for being 
located in the lowest layer of the device driver layer 30, for example, accessing 
hardware, such as various above-mentioned sensors and Actuators 251 -25n 
With the BAWA manager 34 who becomes by the software group which 
manages the change of a power source etc. It consists of a device driver 
manager 35 who becomes by the software group which manages other various 
device drivers, and a dither INDO robot 36 which becomes by the software- 
group which manages the device of robot equipment 1. 

[0044] The manager object 37 consists of an object manager 38 and a service 
manager 39. The object manager 38 is a software group which manages starting 
and termination of each software group contained in the ROBOTIKKU server 
object 32, the middleware layer 40, and the application layer 41, and a service 
manager 39 is a software group which manages connection of each object 
based on the initial entry between each object described by the connection file 



stored in the memory card 28 ( drawing 2 ). 

[0045] The middleware layer 40 is located in the upper layer of the ROBOTIKKU 
server object 32, and consists of software groups which offer the fundamental 
function of these robot equipments 1, such as an image processing and speech 
processing. Moreover, the application layer 41 is located in the upper layer of the 
middleware layer 40, and consists of software groups for opting for action of 
robot equipment 1 based on the processing result processed by each software., 
group which constitutes the middleware layer 40 concerned. 
[0046] In addition, the concrete software configuration of the middleware layer 
40 and the application layer 41 is shown in drawing 4 , respectively. 
[0047] As shown in drawing 4 , the middleware layer 40 The object for noise 
detection, for temperature detection, The recognition system 60 which has the 
input semantics converter module 59 etc. in the object for brightness detection, 
the object for scale recognition, the object for distance detection, the object for 
posture detection, the object for touch sensors, the object for motion detection, 
and each signal conditioning module 50 for color recognition - 58 lists, It consists 
of output systems 69 which have each signal conditioning modules 61-67 for the 
object for posture management, the object for tracking, the object for motion 
playback, the object for a walk, the object for a fall return, the object for LED 
lighting, and sound playback etc. in output semantics converter module 68 list. 



[0048] Each signal conditioning modules 50-58 of the recognition system 60 
incorporate the data with which it corresponds of each sensor data read from 
DRAM11 ( drawing 2 ) by the virtual robot 33 of the ROBOTIKKU server object 
32, or image data and voice data, perform predetermined processing based on 
the data concerned, and give a processing result to the input semantics 
converter module 59. Here, the virtual robot 33 is constituted by the 
predetermined protocol as a part which carries out transfer or conversion of a 
signal. 

[0049] The input semantics converter module 59 It is based on the processing- 
result given from each [ these ] signal conditioning modules 50-58. "The fall was 
detected", [ "it is "noisy", hot / "hot" /, and bright", "the ball having been detected", 
and ] The self of "it was stroked", "it having been struck", "the scale of C-E-G 
having been heard", "the body which moves having been detected", "having 
detected the obstruction", etc. and a surrounding situation, the command from a 
user, and influence are recognized, and a recognition result is outputted to the 
application layer 41 ( drawing 2 ). 

[0050] Application layer 4L, as shown in drawing 5 , it consists of five modules, 
the behavioral model library 70, the action change-over module 71, the study 
module 72, the feeling model 73, and the instinct model 74. 
[0051] As shown in drawing 6 , "when a dc-battery residue decreases", "when 



avoiding an obstruction, and expressing feeling", the behavioral model library 70 
is made to correspond to the condition item of the shoes "at the time of detecting 
a ball" etc. chosen beforehand, respectively, and the behavioral models 701 -70n 
which became independent, respectively "are formed [ "a fall return is carriecT 
out" and ] in it." 

[0052] And these behavioral models 701 -70n The time of a recognition result 
being given from the input semantics converter module 59, respectively, The 
parameter value of the corresponding emotion currently held like the 
after-mentioned at the feeling model 73 if needed when fixed time amount has 
passed, after the last recognition result is given, It opts for the action which 
continues while referring to the parameter value of the corresponding desire 
currently held at the instinct model 74, respectively, and a decision result is 
outputted to the action change-over module 71. 

[0053] In the case of the gestalt of this operation, in addition, each behavioral 
models 701-70n As the technique of opting for the next action As opposed to the 
arc ARC1 - ARCn which connect between to each node NODE0 - NODEn for to 
other nodes NODE0 of which - NODEn it changes from one node (condition) 
NODE0 as shown in drawing 7 - NODEn The algorithm called the finite 
stochastic automaton determined probable based on the transition probability" 
P1-Pn set up, respectively is used. 



[0054] Concretely, each behavioral models 701 -70n are made to correspond to 
the node NODE0 which forms the self behavioral models 701 -70n, respectively - 
NODEn, respectively, and have the state transition table 80 as shown in drawing 
8 for every these node NODE0 - NODEn. 

[0055] In this state transition table 80, the input event (recognition result) made 
into transition conditions in that node NODE0 - NODEn is listed by the train of ao_ 
"input event name" at a priority, and the further conditions about that transition 
condition are described by the corresponding line in the train of a "data name" 
and the "data range." 

[0056] therefore, in the node NODE100 expressed in the state transition table 80 
of drawing 8 When the recognition result of "detecting a ball (BALL)" is given The 
range of "magnitude (SIZE)" of the ball given with the recognition result 
concerned is "0 to 1000", When the recognition result of "detecting an 
obstruction (OBSTACLE)" is given, they have been conditions for that the range 
of "the distance (DISTANCE)" to the obstruction done with the recognition result 
concerned is "0 to 100" to change to other nodes. 

[0057] Moreover, in this node NODE100, when there is no input of a recognition 
result, it also sets. The inside of each emotion held at the feeling model 73 and 
the instinct model 74 which 701 -70n of behavioral models refers to periodically, 
respectively, and the parameter value of each desire, it was held at the feeling 



model 73 "-- glad (JOY) - " - "-- surprised (SURPRISE) - " - or - feeling 
sad (SUDNESS) - " - when the range of one of parameter value is "50 to 100", 
it can change to other nodes. 

[0058] moreover - a state transition table 80 - "-- others, while the node name 
which can change from the node NODE0 - NODEn in the line of the "transition 
place node" in the column of transition probability" of NODOHE is listed It is 
described by the part where it corresponds in the column of transition probability" 
of NODOHE, respectively, the transition probability to each of other node_ 
NODE0 which can change when all the conditions described by the "input event 
name", the "data value", and the train of "the range of data" are met - NODEn - 
"-- others — the action which should be outputted in case it changes to the node 
NODE0 - NODEn - "- others - it is described by the line of "output action" in the 
column of transition probability" of NODOHE. in addition - "— others - the sum 
of the probability of each line in the column of transition probability" of NODOHE 
is 100 [%]. 

[0059] therefore, in the node NODE100 expressed in the state transition table 80 
of drawing 8 for example, when the recognition result that it carries out 
"detecting a ball (BALL)", and the range of "SIZE (magnitude)" of the ball is "0 to 
1000" is given It can change to "a node NODE120 (node 120)" by the probability 
of "30 [%]", and action of "ACTION 1" will be then outputted. 



[0060] When they are constituted as a lot of nodes NODE0 described as such 
[ respectively ] a state transition table 80 - NODEn(s) are connected, and a_ 
recognition result is given from the input semantics converter module 59, each 
behavioral models 701 -70n opt for the next action probable using the state 
transition table of the node NODE0 - NODEn, and are made as [ output / to the 
action change-over module 71 / a decision result ]. 

[0061] The action change-over module 71 shown in drawing 5 chooses from 
each behavioral models 701 -70n of the behavioral model library 70 the action 
outputted from the high behavioral models 701 -70n of the priority beforehand 
defined among the actions outputted, respectively, and sends out the command 
(this is hereafter called action command.) of the purport which should perform 
the action concerned to the output semantics converter module 68 of the 
middleware layer 40. In addition, in the gestalt of this operation, priority is set up 
highly about 701-70n of behavioral models written by the bottom in drawing 6 . 
[0062] Moreover, the action change-over module 71 notifies that the action was 
completed based on the completion information of action given from the output 
semantics converter module 68 after the completion of action to the study^ 
module 72, the feeling model 73, and the instinct model 74. 
[0063] On the other hand, the recognition result of the instruction received as 
influence from a user, such as the study module 72 "was struck" among the 



recognition results given from the input semantics converter module 59 and "it 
having been stroked", is inputted. 

[0064] And based on the notice from this recognition result and the action 
change-over module 71, the study module 72 reduces the manifestation 
probability of that action, when "struck" (scolded), and when "stroked" (praised)7 
it changes corresponding behavioral models [ in the behavioral model library 70 / 
701 -70n ] corresponding transition probability so that the manifestation 
probability of that action may be raised. 

[0065] on the other hand, the feeling model 73 - glad (joy) - " "-- feeling 
sad (sadness) — " — "-- getting angry (anger) — " — "-- surprised (surprise) — " — 
"dislike (disgust)" — and — "— afraid (fear) — " — the parameter with which the 
strength of the emotion is expressed for every emotion is held about a total of six 
emotions. And the feeling model 73 updates the parameter value of each 
[ these ] emotion periodically based on the notice from the specific recognition 
result to which it is given from the input semantics converter module 59, 
respectively, such as "it having been struck" and "it having been stroked", and 
elapsed time and the action change-over module 71 etc. 

[0066] The recognition result to which the feeling model 73 is specifically given 
from the input semantics converter module 59, The amount of fluctuation of the 
action and its emotion when being computed by predetermined operation 



expression based on the elapsed time after updating last time etc. of the robot 
equipment 1 at that time **E [t], The multiplier which expresses the sensibility of 
E [t] and its emotion for the parameter value of the current emotion is set to ke. 
(1) By the formula, as parameter value [ of the emotion in the following period ] E 
[t+1] is computed and this is replaced with parameter value [ of the current 
emotion ] E [t], the parameter value of the emotion is updated. Moreover, the 
feeling model 73 updates the parameter value of all emotions like this. 
[0067] 
[Equation 1] 

E[t + l] = E[t]+kexAE[t] 



[0068] In addition, it is decided beforehand what the notice from each recognition 
result or the output semantics converter module 68 has effect of on amount erf 
fluctuation **[ of the parameter value of each emotion ] E [t]. For example, the 
recognition result of "having been struck" has big effect on amount of fluctuation 
**[ of the parameter value of the emotion of the "resentment" ] E [t], and the 
recognition result of "having been stroked" has big effect on amount of 
fluctuation **[ of the parameter value of the emotion of "joy" ] E [t]. 
[0069] Here, the notice from the output semantics converter module 68 is the 



so-called feedback information (the completion information of action) of actionT 
and is the information on the appearance result of action, and the feeling model 
73 changes feeling also using such information, this - for example, the feeling 
level of the resentment falls by action of "barking" — like — they are things. In 
addition, the notice from the output semantics converter module 68 is inputted 
also into the study module 72 mentioned above, and the study module 72 
changes behavioral models [ 701 -70n ] corresponding transition probability 
based on the notice. 

[0070] In addition, feedback of an action result may be made with the output 
(action to which feeling was added) of the action change-over modulator 71 . 
[0071] on the other hand, "movement avarice (exercise)", "love avarice 
(affection)", "appetite (appetite)", and "the curiosity (curiosity) of the instinct 
model 74" are mutually-independent - the parameter with which the strength of 
the desire is expressed for these the desires of every is held about four desires 
the bottom. And the instinct model 74 updates the parameter value of these 
desires periodically based on the recognition result to which it is given from the" 
input semantics converter module 59, respectively, the notice from elapsed time 
and the action change-over module 71, etc. 

[0072] The instinct model 74 specifically about "movement avarice", "love 
avarice", and "curiosity" The amount of fluctuation of that the desire of the when 



being computed by predetermined operation expression based on the notice 
from a recognition result, elapsed time, and the output semantics converter 
module 68 etc. deltal [k], The parameter value of the current desire as a_ 
multiplier ki showing the sensibility of I [k] and its desire As parameter value [ of 
that desire in the following period ] I [k+1] is computed using (2) types with a 
predetermined period and this result of an operation is replaced with parameter 
value [ of that current desire ] I [k], the parameter value of that desire is updated. 
Moreover, the instinct model 74 updates the parameter value of each desire 
except "appetite" like this. 
[0073] 
[Equation 2] 

I [k + l] = I [k] + ki x AI [k] 



[0074] In addition, it is decided beforehand what the notice from a recognition 
result and the output semantics converter module 68 etc. has effect of oo_ 
amount of fluctuation **[ of the parameter value of each desire ] I [k], for example, 
it has effect to amount of fluctuation **[ of the parameter value of the "fatigue" ] I 



[k] with the big notice from the output semantics converter module 68. 
[0075] In addition, in the gestalt of this operation, it is regulated so that each 
emotion and the parameter value of each desire (instinct) may be changed in the 
range from 0 to 100, respectively, and the value of multipliers ke and ki is also 
set up according to the individual for each [ an emotion and ] the desire of every. 
[0076] On the other hand, abstract action commands, such as it being [ which is 
given from the action change-over module 71 of the application layer 41 as 
mentioned above ] "advance", "it being glad", the output semantics converter 
module 68 of the middleware layer 40 "cries", as shown in drawing 4 , or 
"tracking (a ball is pursued)", are given to the signal conditioning modules 61-67 
with which the output system 69 corresponds. 

[0077] And these signal conditioning modules 61-67 The servo command value 
which should be given to the actuators 251 -25n ( drawing 2 ) in order to perform" 
the action based on the action command concerned, if an action command is 
given, Or the drive data given to LED of a "eye" are generated, the voice data of 
the sound outputted from a loudspeaker 24 ( drawing 2 ) - and - Sequential 
sending out of these data is carried out at the actuators 251 -25n which 
correspond through the virtual robot 33 and digital disposal circuit 14 ( drawing 
2 ) of the ROBOTIKKU server object 32 one by one, a loudspeaker 24, or LED. 
[0078] Thus, in robot equipment 1 , it is made based on the control program as 



[ perform / the situation of self (interior) and a perimeter (exterior), the directions 

from a user, and autonomous action according to influence ]. 

[0079] (3) application of this invention to robot equipment - here, the technique 

to explain is a technique used as the principle for applying this invention to robot 

equipment. 

[0080] (3-1) Explain the outline of a system structure of realizing outline point ** 
of a system structure, and emotion related symbol acquisition (Emotinally- 
Gounded Symbol Acquisition). 

[0081] Here, in building a system first, the following problems are raised, in the 
system which applied this invention, this is solved and implementation of 
LIFE-like (life-like) robot equipment which was not able to be attained in the 
former is aimed at. 

(Req-1) How is language acquisition action embedded at an autonomous 
behavioral system like robot equipment 1? 

(Req-2) How is an emotion related symbol (Emotionally Grounded Symbol) 
constituted? 

(Req-3) How is the recognition object in the real world categorized? 

(Req-4) How is it ****** about cautions between robot equipment 1 and a man at 

the same object? That is, how is the problem of joint cautions (Shared Attention) 

solved? 



[0082] The problem was raised first as mentioned above. First, to (Req-1), it 
solved by unifying the autonomous action generation by the ethology-model 
(Ethological Model), and the approach of physical relation symbol acquisition 
(Physically Grounded Symbol Acquisition). 

[0083] The autonomous action generation by the ethology-model (Ethological 
Model) here for example, Arkin's and others report (Arkin, R.C., Fujita, M., 
Takagi, T., and Hasegawa, and R.Ethological Model submitted to ICRA-2001, 
and the following) it is called reference 6. The report of Bates () [ Bates, ] [ J.] 
The nature of character in interactive worlds and the oz project.Technical Report- 
CMU-CS -92-200, Carnegie Mellon Unversity, Oct. 1992, the following, it is called 
reference 6. It is the technique set and advocated. 

[0084] Moreover, the approach of physical relation symbol acquisition 
(Physically Grounded Symbol Acquisition) is a technique advocated in reference 
1, above-mentioned reference 2, and above-mentioned reference 3. 
[0085] The information acquisition action as action which fills the feeling of 
starvation about information as one of the autonomous actions especially was 
defined, and information acquisition action [ information ] of "eating" is realized 
as the same subsystem as the action which eats food. As information made 
applicable to acquisition, it is the mnemonic name and semantics of an object. 
[0086] Here, a subsystem is a system which specifies action of robot equipment 



1, and this subsystem is in robot equipment 1 also as two or more kinds 
according to the class of action. And the subsystem is made as [ determine / 
mainly / consciousness or an internal state ]. 

[0087] Furthermore, it solves by associating change of the internal state which is 
generating the motive of those actions, and the input at that time and action 
about the above-mentioned emotion related symbol (Emotionally Grounded 
Symbol) of (Req-2). It is specifically associating change of the internal state over 
not the internal state itself but an input when there is an input, and when the 
semantics and its internal state to the individual of the object are fulfilled, relation 
with emotion remembrance makes it possible. 

[0088] Moreover, about (Req-3), the object has been recognized with 
consciousness (Perception) (Categorize), it is using a model statistical as 
KATEGO risers (Categorizer), such as a color detected as consciousness, etc., 
and the recognition object in the real world is categorized appropriately. 
[0089] For example A report of El-Nasr and others proposed in the imagination 
(Virtual) world built in the computer () [ El-Nasr, M., Loeger, T., and Yen, J., ] 
[ PETEELA Pet with ] it is called reference 8 Evolving Emotionaly Intelligence, in 
proceedings of InternationalConference on Autonomous Agents, 2000, and the 
following. The difference from Synthesis Creatur set and advocated is the point 
that robot equipment must be able to operate in the real world. In the body in the 



real world, things, such as a color and a configuration, are continuously 
distributed in each feature space. Furthermore, only by seeing it, if it does not 
program beforehand whether it is what has what kind of semantics actually, it 
cannot know. From such a thing, it solved about above-mentioned (Req-3) using 
the model statistical as a KATEGO riser (Categorizer) of consciousness 
(Perception) etc. 

[0090] It has solved by performing in a natural form using the part of taking the 
action which observed a certain object into action selection of this 
ethology-model (Ethological Model) about the problem of above-mentioned joint 
cautions of (Req-4). 

[0091] There are some which are said to an important function as Shared 
Attention (joint cautions) or Joint Attention by the symbol acquisition (Symbol 
Acquisition) in the real world. In the report (it is called reference 9 Bruner, 
J. Learning how to do things with words, in J. Bruner andA.Garton (Eds.) Humarr 
growth and development, Wolfson College Lectures, Claredon Press, 1978, and 
the following.) of Bruner, setting joint cautions (Shared Attention) like an infantile 
study fault, and carrying out important work is pointed out from cognitive 
psychology etc. For example, when a small child looks at the direction which put 
the finger, and the direction of a look automatically, it is the capacity for the side 
learned the side to teach to share the object to which cautions are turned. 



[0092] It has taken in to autonomous action in the natural form in action selection 
of such joint cautions of an ethology-model (Ethological Model) using the part of 
taking the action which observed a certain object. 

[0093] Hereafter, the behavior control (Behavior Control) in consideration of 
research (Ethological Study) of ethology is explained briefly first. For example, 
the above-mentioned reference 6 is mentioned as a technique of the motion 
control of ethology. 

[0094] Subsequently, it describes how information acquisition action is unifiecL 
with the whole structure for the software of the robot equipment 1 of an 
autonomous mold, and the solution approach about joint cautions is explained. 
[0095] (3-2) Correlation with an external stimulus and an inner condition (Fusion 
of External Stimuli and Internal Variables) 

It is in the point that the consciousness stimulus (Release signal) from the point 
that action is chosen by an internal state and both of an external stimulus, as for 
the crucial point in an ethology-model (Ethological Model), and the motivation 
(Motivation) generation and the external stimulus from an internal state is 
evaluated independently, respectively, and is associated and (fusion) made into 
an action evaluation value (Behavior Value) generate time. Thereby, 
homeostasis action which stops an internal state to a certain within the limits is 
generable. Here, HOMESUTASHISU action is action expressed so that an 



internal state may be kept constant. 

[0096] The configuration for evaluating a corresponding internal state and a 
corresponding external stimulus independently to a certain action is shown in 
drawing 9 . Moreover, it is a configuration for realizing HOMESUTASHISU action, 
and action is systematically constituted by drawing 10 , an external environment 
is understood to it, an external stimulus is obtained to it, and, specifically, the 
configuration to choose the action to which an internal state is kept constant is 
shown in it. 

[0097] About drawing 9 , the case of feeding behavior (ingestive) is mentioned 
as an example, and is explained. The motivation generation section (Motivation^ 
Creator) 101 evaluates and outputs the motivation value (motivation value) of 
feeding behavior from internal states whenever hungry. On the other hand, if the 
release mechanism (release mechanism) 102 has the external stimulus related 
to feeding behavior, for example, food, it will evaluate and output the 
consciousness signal (release signal) of the feeding behavior. And the 
motivation value (motivation value), the release signal, or the consciousness 
signal (release signal) is evaluated independently. 

[0098] The action evaluation section (Behavior evaluator) 103 estimates a 
motivation value (motivation value) and a release signal (release signal), and the 
evaluation value of this action [ itself ] is outputted as an action evaluation value 



(behavior value) in it. Two or more such actions exist and it outputs to the action 
selection section (Action selection) in which each calculates and mentions an 
action evaluation value (behavior value) later independently. In the action 
selection section (Action selection), the action which gave the highest evaluation 
is chosen and the action is performed. 

[0099] Here, by making it define it as making it the action which can be returned 
to the range of a basis, when an internal state shifts the motivation generation 
section (motivation creator) 101 from the suitable range, if the object of the 
action exists in the external world, general action definition of going it to gain will 
be realized, and, thereby, homeostasis action will come to be realized. 
[0100] (3-3) Construction of emotion related symbol acquisition (Emotionally 
Grounded Symbol Acquisition Architecture) 

Emotion related symbol acquisition (Emotionally Grounded Symbol Acquisition) 
has realized information acquisition action to the strange object as a part of 
autonomous action. The configuration with which emotion related symbol 
acquisition (Emotionally Grounded Symbol Acquisition) is realized as a part of 
autonomous action turns into a configuration as shown in drawing 12 . The point 
in this system construction is as follows. 

(i) KATEGO riser of each channel which can distinguish a strange input or a 
known input. 



(ii) Associative storage which memorizes the result of categorizing of each 
channel to the timing from which an internal state changes. 

(iii) Integration by the ethology-model (Ethological Model) of an internal state 
and an external stimulus. 

[0101] The above becomes the point in a system construction. In addition, if an 
external stimulus is a known stimulus, he is trying to take the autonomous action 
based on the homeostasis action by the usual ethology target (Ethological 
Model). 

[0102] Moreover, in the emotion related symbol acquisition (Emotionally 
Grounded Symbol Acquisition) realized with the application of this invention, it is 
also the description that that object memorizes to what of an internal state it is 
important, and it differs from the usual physical relation symbol acquisition 
(Physically Grounded Symbol Acquisition) greatly with this point. 
[0103] Thus, in emotion related symbol acquisition (Emotionally Grounded^ 
Symbol Acquisition), emotion related (Emotionally Grounded) information is 
related with the object, and it is considering as information, and makes it 
possible to evaluate which action (Action) should be carried out by the release 
mechanism (Release Mechanism) also to a new object by relating an emotion 
with an object in this way. 

[0104] Moreover, by having change of an internal state as associative storage in 



relation with an object, when an input of finishing [ study ] is shown, change oL 
the internal state (internal variables) memorized from associative storage to the 
secondary emotion (secondary emotion) is outputted, and, thereby, a secondary 
emotion can also be generated. For example, joy, fear, etc. are made as an 
emotion (emotion). 

[0105] Thereby, corresponding to having seen the object etc., expression can be 
built as emotion expression action, action selection can be affected, or a 
modulation can be given to actuation now. 

[0106] (3-4) Information acquisition action (Information Eating Behavior) 
In order to realize information acquisition action as a part of autonomous action, 
a subsystem (henceforth an information acquisition action subsystem) with the 
variable (henceforth an information acquisition variable) relevant to the 
information acquisition desire as a factor of an internal state is defined as a 
model in which an internal state is shown. 

[0107] For example, the information acquisition variable increases, when 
associative storage learns to a strange input, and an information acquisition., 
action subsystem is defined as an internal model which decrease in number with 
time amount. This information acquisition action subsystem will generate the 
motivation (Motivation) to information acquisition action, if an information 
acquisition variable will be in a deficiency state. 



[0108] Furthermore, in this case, if a release mechanism (Release Mechanism) 
has a strange input (information), it will generate a release signal (release signal). 
Thereby, the action which acquires information can be generated now as 
correlation (fusion) of an internal state and an external stimulus the same with 
eating food. 

[0109] the action which will look for a strange body as a typical thing as concrete 
action expressed as information acquisition action if information acquisition 
avarice becomes large — generating — further — it — receiving — " — it is 
mentioned that this takes question action of what ?" etc. And generally such 
action is formed as a dialogue between users. 

[0110] By building such a system, information acquisition by the dialogue which- 
used curiosity as the base can be realized, and still such information acquisition 
action can embed now automatically into autonomous action. That is, 
information acquisition action is realized as an element with the new interaction 
realized as autonomous action in robot equipment 1 . 
[0111] (3-5) Joint cautions (Shared Attention) 

In the system, Shared Attention or Joint Attention is embedded as inside of 
natural. In a system structure, action of the information acquisition (Information 
Eating) based on joint cautions is performed as follows. 

[0112] above — an internal state and an external stimulus — relating (fusion) - 



suppose that information acquisition action was chosen by the action selection 
section (Action selection) 116. 

[0113] The object with which the release mechanism (Release Mechanism) 102 
became the reason which takes out a release signal is the target which performs 
information acquisition. Moreover, if this action was chosen only from the feeling^ 
of starvation of an internal state, retrieval is performed and a certain object 
becomes the target of information acquisition action as that result. Thus, the 
target which performs information acquisition turns into a target of joint cautions 
(Shared Attention). 

[0114] the case of the information acquisition action resulting from the feeling of 
starvation of the case led by a robot, i.e., an internal state, - robot equipment 1 
— the target - approaching — a finger — putting — " - when this has human 
being's attention paid to the object with the question what ?", joint cautions 
(Shared Attention) are attained. 

[0115] On the other hand, when the user has the leadership (i.e., when a target 
is specified by making into a factor the release signal which the release 
mechanism (Release Mechanism) 102 took out), cautions are first demanded 
from a user because robot equipment 1 moves a sound and an object, while a 
user points out a target with a finger corresponding to this — " — although 
considering a question as what ?" is assumed, this specifies the object put with- 



the finger as that object with robot equipment 1 , when action acquisition action is 
chosen by this finger and question. Thereby, when the user has the leadership, 
the joint cautions over the same object (Shared Attention) are attained. 
[0116] Thus, in this invention, joint cautions (Shared Attention) are incorporated 
as a part of general view that attention is paid to a system to the thing currently 
wanted as an internal state, or what has a strong external stimulus. 
[0117] (3-5) Internal-state change and an emotion (INTERNAL VARIABLES 
AND EMOTIONS) 

As shown in drawing 12 , the feeling section (Emotion part) 130 is roughly 
divided, and consists of the internal-state section 131 for consciousness, the 
internal-state section 132, and the emotion section 133. 

[0118] The 1st internal-state section 132 is a part which manages the dynamics 
of the internal state itself. A nutrient, moisture, fatigue, curiosity, etc. exist in the 
internal state here as a variable in false so that it may mention later ( drawing 
23 ). However, these internal states may be other internal states which it_ 
mentioned above and also can be seen to a living thing or an animal. The 
internal-state section 132 acts as the monitor of the condition required for the 
individual maintenance, and detects that it separates from a suitable value. 
Furthermore, the internal-state section 132 is a part which transmits the signal to 
which action required in order to hold an internal state is urged to the motivation 



generation section (Motivation Creator) to action required in order to keep the 
internal state constant (i.e., in order to maintain homeostasis). 
[0119] The internal-state section 131 for the 2nd consciousness is a part which 
analyzes the input from an internal sensor or an external sensor, and inputs an 
analysis result into the internal-state Management Department. Here, if sensor 
signal analysis is an original animal, it will hit the information about the meal 
detected from the rate of the sugar in blood etc., the information about fatigue, 
etc. In robot equipment 1, although dc-battery residue analysis etc. hits it, in 
robot equipment 1, the input signal for keeping an internal state constant in false^ 
by performing suitable action (Action) supposing false appetite etc. is made. 
[0120] The 3rd emotion section 133 is parts which generate and are pleased 
with **, dysphoria, etc. from change of an internal state, and generate the 
emotion (emotions) corresponding to the resentment etc. It is also called a 
secondary emotion, an internal emotion (this is called primary emotion.) is 
fulfilled, and this emotion section 133 generates **, an unpleasant signal, etc. 
according to condition. Furthermore in the emotion section 133, emotions, such 
as the so-called joy, sadness, and resentment, are generated from this **, an 
unpleasant signal and vigilance, reliability, etc. A secondary emotion is used for 
the actuation for emotion expression, for example, expression generation of a 
face, the optical pattern generation of LED corresponding to it, etc. 



[0121] Change of this internal state is used for the timing of study of the memory 
140 for study (Associative Memory), as shown in drawing 12 . I hear that study is 
performed when an internal state changes a lot, and this has it, if it puts in 
another way. Moreover, an internal state and an emotion condition are inputted 
into the motivation generation section (Motivation Creator) of the action 
(Behavior) generation section, respectively, and are used as a reason of each 
action motive. 

[0122] (3-6) Consciousness of a strange stimulus (PERCEPTION FOR 
UNKNOWN STIMULI) 

Let "recognition" be a big technical problem in development of the robot 
equipment 1 in the real world. Especially, in the real-time recognition under a 
real environment, whether it should identify with the information which has 
already learned the input which changes by various factors, or it is judged as a 
new stimulus produce a big problem. 

[0123] There is statistical pattern recognition (Statistical (or probabilistic) Pattern- 
Classification) as the technique of having obtained the big result in the field of 
such recognition in recent years. This is the recognition technique which treats 
risk function minimization for the input sample distributed over a feature space 
as a statistical problem, and asks for the parameter for it. Hidden-Markov-Model 
(henceforth HMM) made into the current mainstream as utterance recognition 



mentioned later is also the recognition technique of these criteria, and it is the 
typical recognition technique also in image recognition. 

[0124] In this system, it judges whether an input is a strange object and whether 
they are it and a known object using this statistical-pattern-recognition technique. 
[0125] In statistical pattern recognition, a probability or likelihood is given for 
whether an object is that prototype, and it is identifying whether an object is a 
strange stimulus and whether it is a known stimulus using this probability or 
likelihood. Furthermore, when the distance in the feature space of a certain- 
sensor channel is difficult for distinction only by near and this channel and other 
channels are used, a dominance difference is observed and it can perform 
adjusting the discernment parameter in the space of a basis etc. 
[0126] (3-7) Memory for study feeling is remembered to be (ASSOCIATIVE 
MEMORY WITH EMOTIONS) 

The memory for study (Associative Memory) is for learning to a trigger that the 
internal state changed with the outputs of each channel for consciousness 
(Perceptual Channel). Here, study is carrying out associative storage of change 
of an internal state specifically made into the trigger such, and the object which 
the internal state's was changed, namely, affected the internal state. 
[0127] Here, change of an internal state is produced based on the amounts 
(current consumed at a joint) which can actually be sensed in the sensor signal 



analysis described in the above-mentioned "an above-mentioned internal-state 
(3-5) change and an emotion (INTERNAL VARIABLES AND EMOTIONS)", and 
the amount (detection of carrying out actuation of eating to false food) sensed in 
false, the current consumed at a joint here — for example, it is determined by the 
count which operated and the factor of the "fatigue" is constituted. 
[0128] Connection of the event produced in coincidence is learned based on the 
probability or likelihood which belongs to the number and prototype (prototype) 
of the prototype (prototype) sent from a consciousness channel (Perception 
Channel) as association. In the event here, the so-called physical relation 
symbols (Physically Grounded Symbol), such as a name to the object sent- 
through action generation, are also contained, and this is also gained as study. 
[0129] Furthermore, similarly associative storage of the action performed to 
coincidence to the change and the object of an internal state used as a trigger is 
carried out. If what kind of action is taken to the object, it will mean that it was 
memorized by this of what kind of internal state change takes place. Such study 
becomes acquisition of an emotion related symbol (Emotionally Grounded 
Symbol). 

[0130] Here, directly, since it is change of an internal state, it is called a primary 
emotion, but since an emotion (Emotion) can produce a secondary emotion by 
change of a primary emotion, it is the symbol (Symbol) which related (Grounded) 



and was made fear etc. 

[0131] (3-8) A subsystem and action (SUBSYSTEMS AND BEHAVIORS) 
Action is controlled based on the subsystems (subsystem) 1 151-1 15n made into 
two or more action groups which can be classified as shown in drawing 10 . 
Subsystems 1 151-1 15n are layered structures, and have a tree structure, and 
turn into a subsystem with the actual top layer. 

[0132] For example, in research of the ethology which Arkin and others has 
reported by the above-mentioned reference 6, the subsystem considered to be 
enough required as canny behavior is mentioned. The description of the 
technique reported by reference 6 is defining the feeding behavior (Investigative) 
which is one of the subsystems as action of eating information, as shown in 
drawing 11 . For example, a subsystem called feeding behavior (ingestive) is- 
defined as action of eating food (electrical and electric equipment). Thereby, 
ideally, by making a dc-battery residue into an internal state, if action which 
maintains it at a certain within the limits is generated and a dc-battery decreases, 
it is supposed that it is possible to generate the motivation (Motivation) which 
generates action called retrieval of a charge location, charge desire, or 
automatic battery charge. 

[0133] Such a view was introduced in the step of information acquisition, the 
thing corresponding to "the amount of study of new information" was prepared 



as an item of an internal state, and factors, such as time amount, define the 
dynamics of an internal state which decreases in this system. And in the 
dynamics of such an internal state, the action according to "the amount of study" 
is generated like the case of a dc-battery. Namely, if robot equipment 1 acts so 
that "the amount of study" may be maintained at a certain within the limits, and 
its the "amount of study" decreases, in order to acquire new information, [ for 
example, ] If retrieval of a strange object and a strange object exist as an 
external stimulus, action of learning the identifier which approached it, put the 
finger, and carried out action called "what is this? (this is what ?)", or people 
uttered by associative storage will be generated. Here, it is the variation to which 
the amount of study is determined according to the description of the study 
object, for example, and it is made for the amount of study to decrease with time. 
[0134] Furthermore, although the identifier of an object was learned, the action 
which gains what kind of semantics it has to an internal state can also be defined^ 
This is realizable by carrying out associative study of the action (action) and 
internal-state change, when action in the object is tried and an internal state 
changes. 

[0135] (4) Application to actual robot equipment (IMPLEMENTATION) 

(4-1) Structure of the robot equipment of a quadrapedalism mold (Enhanced 

Four-legged Robot Platform) 



The robot equipment 1 of the quadrapedalism mold with which the_ 
above-mentioned system was mounted is explained. An example of the network 
system equipped with robot equipment 1 as a configuration is shown in drawing 
13 . 

[0136] In this network system, robot equipment 1 is connected to a network by 
using the card 161 for wireless LAN (wireless LAN card) using the protocol of 
TCP/IP (Transmission Control Protocol/Internet Prorocol). 

[0137] Robot equipment 1 is equipped with CPU and 16MB of main memory with 
the property of about 100MIPS of MIPS R4XXX. And this robot equipment 1 is 
equipped with the object (object) of Speech which considers the software 
performed [ primitive behaviors / (BASIC posture transition, to search an object, 
to track an object, to close to an object, to kick an object.to eatan object, etc) ] as 
an output, and a phonetic symbol train as an input. Moreover, the command 
which LED corresponding to an eye is used for robot equipment 1 , and builds the 
expression of shoes is also prepared. 

[0138] In such robot equipment 1, a system which was mentioned above is buiJL 
and information acquisition action expresses robot equipment 1 as for example, 
a part of autonomous action. 

[0139] Furthermore, also in a workstation 163 top, processing in robot 
equipment 1 and same processing can be performed with the network system to 



which such robot equipment 1 is connected. For example, thereby in a 
workstation 163 top, the check of operation in robot equipment 1 can be carried 
out now. About the case where it processes on a workstation 163, it is made as 
follows. 

[0140] An input captures a picture signal (capture) and robot equipment 1 
transmits an image to an access point 162 through wireless LAN (wireless LAN) 
with the card 161 for wireless LAN. And an image is transmitted to a workstation 
163 through Ethernet (ethernet) (trademark) from an access point 162. 
[0141] Moreover, the sensor detection information by the joint include-angle 
detection in robot equipment 1, a touch sensor, an acceleration sensor, etc. as 
well as the case where an image is transmitted to a workstation 163 from such 
robot equipment 1 is transmitted to a workstation 163. Moreover, when 
processing in a workstation 163 for example, in this way, it can also input with 
the microphone of a workstation 163, without using the microphone of robot 
equipment 1 about a sound. 

[0142] On a workstation 163, above-mentioned Perception, Evaluation for 
internal variable, Behavior subsystem, action selection, etc. are performed using 
the input signal of an above-mentioned image etc. These functions design an 
OPEN-R object (OPEN-R objects) on a workstation as well as the inside of robot 
equipment by OPEN-R (system which Sony Corp. offers) mounted for example, 



on Linux, and are realized by combining them freely on a network. For example, 
current is operating by mixture of a Matlab program and OPEN-R objects on 
Linux. 

[0143] (4-2) The function and experimental result (Implemented Functions and 
ExperimentalResults) of the system 

Finally robot equipment 1 is made by applying this invention as [ express / the 
information acquisition action or emotion ascertainment behavior by joint 
cautions as a part of autonomous action ]. It divides roughly, a phase is stepped 
on to autonomous action (step S1), the input (step S2) of an object, and action 
selection (step S3), and the information acquisition action and information 
ascertainment behavior by joint cautions are made to specifically express finally, 
as robot equipment 1 is shown in drawing 14 (step S4). And robot equipment 1 is 
processing such each phase as a part of autonomous action. 
[0144] (4-2-1) Consciousness section (Perception Part) 

As shown in drawing 10 , it has the consciousness section 111 in robot 
equipment 1. As shown in drawing 12 , specifically, the consciousness section 
121 is equipped with the color perception section 122 for perceiving an image 
and the mold consciousness section 123, the contact consciousness section 
(tactile-sense section) 124 that perceives contact, and the speech-perception 
section 125 which perceives a sound. 



[0145] The color perception section 122 is a part which performs the 
below-mentioned automatic color segmentation from the information on an 
object, and the mold consciousness section 123 is a part which analyzes the 
mold of an object based on image information, and, specifically, the 
speech-perception section 125 is a part which carries out utterance recognition 
to the utterance input from a microphone. The following explanation turns into 
explanation about the processing made in such each consciousness section. 
[0146] Moreover, the contact consciousness section 124 detects the contact to 
an object with the signal from the so-called **** sensor made into the shape of 
so-called meat globular form with which the sole of robot equipment 1 was 
equipped. 

[0147] (4-2-1-1) Automatic color segmentation (Automatic Color Segmentation) 
The color segmentation using a color is first performed in the input of a 
consciousness stimulus. In color segmentation, it is supposed that it is possible 
to carve two or more objects which consist of a single color of arbitration^ 
Moreover, in color segmentation, what is depended on the clustering algorithm 
by teacher-less study is used. 

[0148] The result (inside of drawing (B)) of the color segmentation is indicated to 
be the object (inside A of drawing) applied artificially to drawing 15 . Moreover, 
the result (inside B of drawing) of the natural image (inside A of drawing) which 



contains the face of the natural image containing human being's hand and a man 
in drawing 16 , and its color segmentation is shown. 

[0149] Here, an input image is already dropped by 88 x 60 pixels through Low 
pass filter at the time of the input to a system from the camera of a comparatively 
narrow angle of visibility (53 x 41 whenever). Segmentation is performed only by 
the processing which became independent to every pixel (pixel), taking this into 
consideration. By doing in this way, a good result as shown in [ B ] the inside B of 
drawing 15 and drawing 16 can be mostly obtained on real time. 
[0150] Moreover, although color segmentation is performed in RGB or the 
normalized RGB space in many cases, since the signals of a camera are Y, Cr, 
and Cb format (Nr, Nb), it usually makes a color space two-dimensional space of 
= (atan (Cr/Y), atan (Cb/Y)). When the error at the time of quantizing with the 
computational complexity produced in case it maps to RGB space etc. is taken 
into consideration, it is very efficient processing. 

[0151] In addition, such color segmentation is used as initial processing for 
shape analysis. 

[0152] Below, the example of the processing step (i) of the algorithm of the- 

clustering in above-mentioned color segmentation - (vi) is shown. 

[0153] At a step (i), a suitable number of prototypes (prototype) are arranged 

uniformly. 

I 



[0154] At a step (ii), the class label to the nearest prototype (prototype) is 

attached to all pixels by making the following (3) types into distance. 

[0155] 

[Equation 3] - 



[0156] Here, as shown in drawing 17 , it is distribution corresponding to hue and 
saturation, respectively, and sigmahue and sigmasat ask for these from 
distribution of a suitable sample image beforehand, and, generally are sigma 
hue<sigma sat. That is, the distance which gave weight to the error of the hue 
direction can be considered. — 
[0157] At a step (iii), when there are few pixels belonging to the prototype, the 
prototype is changed. 

[0158] At a step (iv), the prototype is moved to the mean position which the 
same class label attached. 

[0159] At a step (v), when it is below distance with two or more prototypes, it 
collects into one. 

[0160] At a step (vi), if renewal of the location of a prototype decreases, or if it 
becomes a suitable count, it will end. Except it, it returns to an above-mentioned 




• • . (3) 



step (ii), and processing is started again. 

[0161] In addition, the situation of the clustering to an input image is shown in 
drawing 18 . In the example shown in drawing 18 , the beige field memorized 
beforehand is analyzed and the case where the body on detection and the 
production of the direction in which a finger is present very is being shown is 
shown. For example, this information is used in the below-mentioned joint_ 
cautions (Shared Attention). 
[0162] (4-2-1-2) Mold analysis (Shape Analysis) 

Mold analysis (Shape Analysis) is performed using the fourier descriptor (FD) 

which are magnitude and rotational universality characteristic quantity. For 

example, in this mold analysis, categorizing uses L2 norm in the space (64 

dimensions) of Fourier Descriptor. It determines whether to express the inputted 

body in FD space and use it as a new prototype using distance with the nearest 

prototype. In addition, the result of the shape analysis of the body cut down by 

color segmentation is shown in drawing 19 . 

[0163] (4-2-1-3) Utterance recognition (Speech Recognition) 

The continuation utterance recognition using HMM as utterance recognition 

(Speech Recognition) is used. There is a technique advocated in the 

above-mentioned reference 5 as this technique. 

[0164] This system is equipped with the voice input section 171, the HMM 



register 172 equipped with two or more HMM(s), HMM173 for an unknown word 
input, and a comparator 174 as shown in drawing 20 . 

[0165] HMM of the HMM register 172 is HMM which carried out Japanese 
phoneme study, and the required word is registered beforehand. Moreover, that 
by which the word gained in late-coming is learned is also contained in HMM of 
the HMM register 172. Here, a noun, a verb, etc. are mentioned as a word 
gained, for example or it was registered. The inputted phoneme sequence is 
evaluated as reliability in HMM of such a HMM register 172. 
[0166] HMM173 for an unknown word input is HMM for unknown word 
acquisition. As shown in drawing 21 , this HMM173 for an unknown word input 
made all the phoneme models the State, and has combined them with all the 
phoneme State. For example, HMM173 for an unknown word input is recognized 
as "booru", when the utterance input "bouruu" is made, as shown in drawing 21 . 
[0167] Although the inputted phoneme sequence is evaluated in HMM of the 
word already registered or gained, and this HMM173 for an unknown word input, 
distance with HMM which matched max using reliability (verification value) is 
evaluated in a comparator 174 at this time. And if it is beyond a value with 
reliability (verification value), a label new as a new phoneme sequence will be 
attached, and it will be registered as HMM of the HMM register 172. 
[0168] As an example, the HMM register 172 explains the case where it has only 



that into which the two words "tomare" (stop) and "kere" (kick) are registered as 
HMM. The result at the time of using such a system is shown in drawing 22 . 
[0169] In drawing 22 , the value of the reliability (verification) of the input signaL 
over the registered word is shown in right-hand side. In addition, the value of 
reliability of this reliability (verification) is so high that it is low. 
[0170] For example, it presumes that a system is the input of the phoneme 
sequence of "tomoare" to the utterance "tomare", and the value of the reliability 
(verification) is 0.136. 

[0171] On the other hand, the model which suits from a top most to the input of 
the unknown word the 3rd "booru" (ball), in drawing 22 is "tomare", 4.835 and 
since it is very large, a new symbol called unknown-1 is assigned and the 
reliability (verification) is registered for it. Thereby, to the utterance input of 
"booru" (ball) which shows a system from a top to the 4th in drawing 22 which is 
a next utterance input, HMM corresponding to unknown-1 takes a value with as 
small most near and its reliability (verification) as 0.41, and "booru (ball)" comes 
to be correctly gained by unknown-1. 

[0172] Moreover, in this system, since HMM is possible for continuation 
utterance recognition, it is supposed following label unknown-1 to "boorulL 
previously gained from the top to "booru kere" in drawing 22 like the 7th 
utterance that it is possible to recognize a symbol called kere. 



[0173] the system of such utterance recognition - for example, it can kick and 
rich — having — etc. - it is . It will be "ball if the noun a "ball" is gained. It can kick 
and robot equipment 1 can kick a ball now with the instruction 
[0174] (4-2-1-4) Feeling section (Emotion Part) 

The relation of the action (subsystem) relevant to an internal state (Internal 
Variables) and it is shown in drawing 23 . 

[0175] It referred to the physiology model of feeding behavior etc., and this 
example defines that quantity to be stored as an internal state supposing an 
imagination in-the-living-body nutrition storage buffer and the buffer for 
elimination for general internal-state maintenance. They are the amount and 
Fake of Energy-2 (false food, Fake Food). It is the amount of excrement 
(excrement). _ 
[0176] For example, he is trying for reduction of an imagination, stomach 
quantity to be stored to bring about the increment in quantities to be stored, such 
as an imagination bladder, by associating the imagination stomach 
(in-the-living-body nutrition storage buffer), an imagination bladder, or intestines 
(buffer for elimination), as shown in drawing 24 . 

[0177] As shown in drawing 23 , it has dynamics which increase or decrease by 
a certain factor. Fundamental actuation of the motivation generation section 
(Motivation Creator) will raise the motivation (Motivation) of an action group 



(subsystem), in order to maintain this internal-state variable at a certain 
tolerance. 

[0178] Moreover, although it is thought that false food and water (Fake) are 
mounted mainly in the purpose of the enjoyableness (Entertainment) of robot 
equipment 1, the inner state variable equivalent to the electrical and electric 
equipment Energy in original semantics and fatigue also exists. The increment 
and reduction factor which these also show to drawing 23 constitute dynamicsr 
and the motivation generation section (motivation creator) of a corresponding 
subsystem (subsystem) is made as [ give / so that this may be kept constant / 
the motive of action ]. However, when it does not have such 
automatic-battery-charge action, robot equipment 1 issues the action which 
requires it about charge, and it is made to have the others (human being) charge 
it, although automatic-battery-charge action with which robot equipment 1 
equips the so-called charging equipment as autonomous action is also 
considered. 

[0179] Moreover, the same internal-state variable is prepared also in the 
information acquired by associative storage. By associative storage, the internal 
acquisition amount of information of imagination semantics is calculated, and it 
is sent. In this case, without oblivion, although it is only that the amount of 
internal information of associative storage increases, it is not necessary to 



mount oblivion. The easy dynamics of an increment factor and a time reduction^ 
factor are built for the integral of each amount of information of suitable time 
amount within the limits, and the motive of an information acquisition action 
subsystem is constituted. 

[0180] (4-2-1-5) The memory section for study (Associative Memory Part) 
The concrete configuration of the memory 140 for study (Associative Memory) 
which robot equipment 1 uses for information acquisition is shown in drawing 25 . 
The memory 140 for study is equipped with the ** memory 182 and the ** 
memory 183 for cautions the memory 181 for short periods, and over a long 
period of time, as shown in drawing 25 . As shown in drawing 12 , specifically, it 
has this memory 140 for study. 

[0181] The memory 140 for study (Associative Memory) functions by such 
configuration as the storage section which has one identifier in a certain color 
and a certain form, and functions further as the storage section of what kind of 
semantics the very thing has to the inner condition of robot equipment 1. 
[0182] In the memory 181 for short-term memory (Short Term Memory, STM)^ 
the information on eclipse ****** with an ID number in an image is stored. At this 
time, the information on objective is the information on the prototype number 
(CP-i) of a color, and the prototype number (SP~j) of a configuration. Moreover, 
the word sequence for one utterance inputted from speech processing is 



inputted into the memory 181 for short periods (Short Term Memory). 
[0183] The data from an image are sent to the action generation section 
(Behavior Generator) 150, as an objective name (HMM-k) and the effect (Delta-I) 
on an internal state are obtained by considering the prototype number (CP-i) of a 
color, and the prototype number (SP-j) of a configuration as an input, it considers 
as a bundle and these are shown in drawing 12 . When an objective name 
(HMM-k) and the effect (Delta-I) on an internal state are not obtained, that is sent 
by carrying out in null (nil) information. Utterance data are sent to the action 
generation section (Behavior Generator) 150 as it is. 

[0184] On the other hand, although action (Action) and its object object (Obj-ID) 
are chosen in the action selection section (Action Selection) 116, this informatiorT 
is sent to the memory 140 for study (Associative Memory) from the action state 
machine (Behavior State Machine) mentioned later. The information 
corresponding to this object object (Obj-ID) is stored in the ** memory 183 for 
cautions (Attention Object Memory, AOM) from the memory 181 for short 
periods (ShortTerm Memory). In addition, the uttered word sequence which is 
then contained in the memory 181 for short periods (Short Term Memory) is sent 
to the ** memory 183 for cautions (AttentionObject Memory) as it is. 
[0185] Timing of study to the ** memory (Long Term Memory) 182 is performed 
considering internal-state change as a trigger over a long period of time which 



functions as original memory for study (Associative Memory) from the ** memory 
183 for cautions (Attention Object Memory). Thereby, when carrying out a 
certain action to a certain object (Object), and an internal state changes, it 
relates with the object and internal-state change is memorized. 
[0186] (4-2-1-6) Action generation section (Behavior Generation Part) 
Here, the information acquisition action subsystem of the subsystems which 
specify action of robot equipment 1 is explained. As shown in drawing 26 , it is 
constituted information acquisition action subsystem 151n as what has a layered 
structure. 

[0187] One software object (software object) exists in the subsystem layer of 
action. 

[0188] If it separates from the range where the above-mentioned amount of 1st 
order-internal storages is suitable, the motivation generation section (Motivation^ 
Creator) 101 of this software object (software object) is constituted so that a 
motivation value (motivation value) may be outputted. 
[0189] 
[Equation 4] 

MC_val = 1 - tanh (lnt_val) + e •••(*) 



[0190] On the other hand, the release mechanism (Release Mechanism) 102 is 
made by investigating the object (Object) sent from the memory 140 for study 
(Associative Memory). By the release mechanism (Release Mechanism) 102, 
the consciousness (release) factor about pointing by the thing and human being 
of current strangeness is taken into consideration. Here, for example, a 
consciousness factor is the effect (Act:Delta-l) of the identifier (Obj:Name) of an 
object (Object), the identifier (ColonName) of Color, the identifier (Shape:Name) 
of Shape, and the internal-state change on the object (Object). 
[0191] The release mechanism (Release Mechanism) 102 creates a release 
signal (Release signal), if the informational definition is not made by what was 
obtained as a consciousness factor. And as what accumulated the number of the 
undefined to one object, the value of the release signal (release signal) which 
the release mechanism (Release Mechanism) 102 outputs corresponds to the 
body, and is determined as it. For example, it can also be aimed only at the 
identifier (Obj:Name) of an object, and the effect (Act:Delta-l) on internal-state 
change. 

[0192] And the release mechanism (Release Mechanism) 102 evaluates a 
release signal (release signal) to the object which exists, chooses an object with 
the biggest value, and outputs ID which specifies the selected object (Obj), and 
a release signal (release signal). 



[0193] For example, when an apple specifies as an object, to robot equipment 1, 
the mold and color are analyzed using mold analysis and color segmentation- 
which were mentioned above, and the identifier (Color: Name) of Color as a 
consciousness factor and the identifier (Shape:Name) of Shape are evaluated to 
it. When the apple is registered beforehand, it considers also as what has a high 
evaluation value, and is obtained, and it is recognized that an object is an apple 
by this. And ID which specifies the apple used as the selected object, and the 
release signal (releasesignal) at that time are outputted. Moreover, when the 
apple is not registered beforehand, the number of undefined is accumulated and 
this is made to correspond to the apple as a strange object. 
[0194] On the other hand, about pointing by human being, the release 
mechanism (Release Mechanism) 102 is set up so that a still bigger release 
signal (release signal) may be generated. And the release mechanism (Release 
Mechanism) 102 is generating the release signal (release signal) irrespective of 
whether the body is strange or it is known, when the body detection by pointing 
is made. This is based on the idea of making it take ascertainment behavior to a 
known thing or pointing is a demand of information acquisition or an information- 
check and wants to make information acquisition action clearly attracted from 
human being, without being greatly dependent on an internal state. 
[0195] And in information acquisition action subsystem 151n, what carried out 



the multiplication of this release signal (release signal) and the motivation value 
(motivation value) is obtained as an action evaluation value (behavior value). 
Moreover, in each of other subsystem (subsystem) which specifies Eating etc., 
an action evaluation value (behavior value) is similarly acquired using the- 
release signal (release signal) inputted into information acquisition action 
subsystem 151n, and a motivation value (motivation value). 
[0196] And in the action selection section 116, the action evaluation value 
(behavior value) from each subsystem (subsystem) is compared, and it is 
chosen as a subsystem which a subsystem (subsystem) with the biggest action 
evaluation value (behavior value) performs. By explanation, it becomes the case 
where the action evaluation value (behavior value) in information acquisition 
action subsystem 151n is made max by the comparison of such an evaluation 
value, by ******. 

[0197] In addition, although it is necessary to continue choosing the selected 
subsystem (subsystem) for a while, this can realize it according to mutual 
inhibition, a fatigue factor (fatigue factor), etc. 

[0198] If information acquisition action subsystem 151 n is chosen, as shown in 
drawing 26 , it will progress to the hierarchy called Mode (Mode) MD next. In 
Mode (Mode) MD, similarly, although informational selection processing is mader 
specifically in the mode (Mode), the body according [ selection of the upper 



layer ] to pointing and the body chosen itself, i.e., a strange body, and ** are 
distinguished. In this mode (Mode) MD, if distinction is made, as shown in 
drawing 26 , the evaluation to concrete action will be made in the layer called 
module (Module) MJ used as that lower layer. Based on this evaluation, 
selection of concrete action is made in the action selection section 116. 
[0199] Thereby, robot equipment 1 will come to take the ascertainment behavior^ 
if an object is a known thing, and if an object is strange, it will come to take 
acquisition action. For example, information acquisition action investigates the 
object of a subsystem (subsystem) which gave maximum evaluation by the way, 
when two kinds of information acquisition is made under the identifier 
(Obj:Name) of an object, and the effect (Act:Delta-lnt) on internal-state change, 
and either can be chosen. 

[0200] For example, as processing in the case of performing ascertainment 
behavior, an instruction is sent to the state machine corresponding to the 
ascertainment behavior, and ascertainment behavior of the identifier is 
performed, and - while robot equipment 1 carries out visual tracking (Visual 
Tracking) for the body which human being put with the finger — approaching — 
and the body - a finger — putting — namely, the nose gear — putting — " — this is 
XX -- actions like, such as ?", are made to express Such action is realized by 
controlling by the state machine the action sequence which specifies such action 



was described to be. 

[0201] As processing in the case of carrying out acquisition action of the 
identifier (Obj:Name) of an object, it is sent to the state machine for acquisition of 
the identifier (Obj:Name) of the object with which the output corresponds. It 
approaches carrying out visual tracking (Visual Tracking) to the object, a finger is 
put, and the action "identifier ? called what in this" is made to express in 
acquisition action of the identifier (Obj:Name) of an object. Moreover, suitable 
behavior control is made using distance with an object at this time. Such action 
is realized by controlling by the state machine the action sequence which 
specifies such action was described to be. 

[0202] And if there is a thing effective in an output from the utterance recognition 
section which followed "identifier ? called what in this", and was inputted, a state 
machine which repeats and checks the phoneme sequence is also incorporable. 
[0203] On the other hand, if the acquisition action under the effect (Act:Delta-lnt) 
on internal-state change, i.e., the acquisition action to the strange object based 
on internal-state change, is chosen, the object is received, and action of shoes- 
will be chosen at random and will be performed. And associative storage 
estimates the effect (Delta-lnt) on internal-state change then produced. Thereby, 
since this object relates (Grounding) and is made into an internal state, the effect 
on the internal-state change to a new object comes to be made as semantic 



acquisition. 

[0204] For example, when an apple is seen and an internal state changes to "**" 
then, change of the internal state is made to correspond to the apple which is an 
object. Henceforth, it means that robot equipment 1 makes an apple **, and 
comes to carry out semantic interpretation, and semantic acquisition of an apple 
was made in robot equipment 1 by this. As mentioned above, by applying this 
invention, robot equipment 1 can make information acquisition action able to 
express as a part of autonomous action, can perform the joint cautions as 
optimal behavior, and can acquire the semantics of the strange object acquired 
as change of an internal state in still such information acquisition action, thereby^ 
~ robot equipment 1 — more ~ LIFE — being -like (Life-like) - it was brought 
close. 

[0205] In addition, therefore, implementation of application of this invention to 
robot equipment 1 which was mentioned above is enabled with software. 
[0206] 

[Effect of the Invention] The robot equipment concerning this invention can 
express information acquisition action as 1 action of autonomous action by 
having the behavior control means to which information acquisition action is 
carried out as 1 action of autonomous action. 

[0207] Moreover, when the behavior control approach of the robot equipment 



concerning this invention carries out information acquisition action as 1 action of 
autonomous action of robot equipment, robot equipment can express 
information acquisition action as 1 action of autonomous action. 
[0208] Moreover, the robot equipment concerning this invention can acquire the 
semantics of an object now by having a semantic acquisition means to acquire^ 
the semantics of an object. 

[0209] Moreover, by gaining change of an internal state when, as for the 
behavior control approach of the robot equipment concerning this invention, the 
robot equipment which is acting based on the internal state carries out action to 
an object as semantics of the object concerned, robot equipment can act based 
on an internal state, and can gain change of the internal state when carrying out 
action to an object as semantics of the object concerned. 

[0210] Moreover, two or more word sequence description models classified 
based on the characteristic quantity of the word sequence at the time of the 
robot equipment concerning this invention speaking with a voice input means, 
By having an utterance input evaluation means to evaluate the utterance input 
made by the voice input means based on the word sequence description model, 
and a word sequence specification means to specify the word sequence of an 
utterance input based on the evaluation value of an utterance input evaluation 
means Based on two or more word sequence description models classified^ 



based on the characteristic quantity of the word sequence at the time of 
speaking, an utterance input evaluation means estimates the utterance input 
made by the voice input means. Based on the evaluation value of an utterance 
input evaluation means, the word sequence of an utterance input can be 
specified with a word sequence specification means. Thereby, robot equipment 
can specify the inputted utterance as optimal word sequence. 
[0211] Moreover, the behavior control approach of the robot equipmenL. 
concerning this invention The utterance input evaluation process of evaluating 
the utterance input made at the voice input process and the voice input process 
based on two or more word sequence description models classified based on 
the characteristic quantity of the word sequence at the time of speaking, Robot 
equipment can specify the inputted utterance as optimal word sequence by 
having the word sequence specification process of specifying the word 
sequence of an utterance input, based on the evaluation value acquired at the 
utterance input evaluation process. 

[0212] Moreover, the robot equipment concerning this invention can carry out 
action indicating the study object of self by having the control means which 
carries out behavior control indicating the study object of self. Thereby, come to 
let the joint cautions between robot equipment and a user be a positive thing. 
[0213] Moreover, when the behavior control approach of the robot equipment 



concerning this invention controls action of robot equipment so that the robot 
equipment which carries out autonomous action points to the study object of self, 
robot equipment can carry out action indicating the study object of self. Thereby, 
come to let the joint cautions between robot equipment and a user be a positive 
thing. 

[0214] Moreover, the sensor by which the robot equipment concerning this 
invention detects an object and the evaluation section for consciousness which 
evaluates the input signal from a sensor, By inputting the evaluation result of the 
evaluation section for consciousness, and having a storage means to memorize, 
the relation between the internal-state Management Department which manages 
the false internal state which changes based on the evaluation result concerned, 
and change of the internal state based on an object and the object concerned 
When an object is detected, the change and the above-mentioned object of the 
above-mentioned internal state based on the detected object are related, and it 
can memorize for the above-mentioned storage means. 

[0215] Moreover, the behavior control approach of the robot equipment 
concerning this invention The consciousness evaluation process of evaluating 
the input signal from the sensor which detects an object, By having the 
internal-state management process of managing the false internal state which 
changes based on the evaluation result in a consciousness evaluation process, 



and the storage process which memorizes relation with change of the internal 
state based on an object and the object concerned for a storage means When 
an object is detected, robot equipment relates the change and the 
above-mentioned object of the above-mentioned internal state based on the 
detected object, and can be memorized for the above-mentioned storage means. 



DESCRIPTION OF DRAWINGS 
[Brief Description of the Drawings] 

[Drawing 1] It is the perspective view showing the appearance configuration of 
the robot equipment which is the gestalt of operation of this invention. 
[Drawing 2] It is the block diagram showing the circuitry of above-mentioned 
robot equipment. 

[Drawing 3] It is the block diagram showing the software configuration of 
above-mentioned robot equipment. 

[Drawing 4] It is the block diagram showing the configuration of the middleware 
layer in the software configuration of above-mentioned robot equipment. 
[Drawing 5] It is the block diagram showing the configuration of the application 
layer in the software configuration of above-mentioned robot equipment. 



[Drawing 6] It is the block diagram showing the configuration of the behavioral 
model library of an above-mentioned application layer. 

[Drawing 7] It is drawing used in order to explain the finite stochastic automaton 
used as the information for the action decision of robot equipment. 
[Drawing 8] It is drawing showing the state transition table prepared for each 
node of a finite stochastic automaton. 

[Drawing 9] It is the block diagram showing the configuration section which 
chooses action. 

[Drawing 10] It is the block diagram showing the configuration section which 
chooses action by consciousness. 

[Drawing 11] It is drawing showing the example of a subsystem. 
[Drawing 12] It is the block diagram showing the more concrete configuration 
section of a configuration of choosing action. — 
[Drawing 13] Robot equipment is the flow chart which shows a series of 
procedures until it expresses information acquisition action or information 
ascertainment behavior by joint cautions. 

[Drawing 14] It is drawing showing the configuration of the network system 
containing robot equipment. 

[Drawing 15] It is drawing used for the explanation about the color segmentation 
of the input image which consists of a single color of arbitration. 



[Drawing 16] It is drawing used for the explanation about the color segmentation 
of the input image with which human being was contained. 
[Drawing 17] It is drawing used for explanation of clustering of color 
segmentation. 

[Drawing 18] It is drawing showing the situation of clustering of an input image. 
[Drawing 19] It is drawing showing the result of the appearance analysis started 
by color segmentation. 

[Drawing 20] It is the block diagram showing the configuration section which 
realizes utterance recognition. 

[Drawing 21] It is drawing showing the example of a configuration of HMM for an 
unknown word input. 

[Drawing 22] It is drawing showing the result of utterance recognition. 
[Drawing 23] It is drawing showing the information about an internal state. 
[Drawing 24] It is drawing showing relation, such as the imagination stomach 
and an imagination bladder. - 
[Drawing 25] It is the block diagram showing the configuration of the memory for 
study. 

[Drawing 26] It is drawing showing processing until it expresses the information 
acquisition action or information ascertainment behavior by joint cautions from 
the information based on an external stimulus and an internal state. 



[Description of Notations] 

1 Robot Equipment, 10 CPU, 101 Motivation Generation Section, 102 Release 
Mechanism, 103 Evaluation Section of Operation, 111 Consciousness Section, 
112 Internal-State Section for Consciousness, 113 Internal-State Section, 114 
Emotion Section, 115 Subsystem, 116 Action Selection Section, 140 Memory 
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